Jun 10 00:59:17.775495 ip-10-0-142-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 00:59:17.775508 ip-10-0-142-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 00:59:17.775517 ip-10-0-142-1 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 00:59:17.775710 ip-10-0-142-1 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 00:59:27.814848 ip-10-0-142-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 00:59:27.814864 ip-10-0-142-1 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 58cb42e8c3c54e7782db3adcba82624c -- Jun 10 01:02:05.143415 ip-10-0-142-1 systemd[1]: Starting Kubernetes Kubelet... Jun 10 01:02:05.633883 ip-10-0-142-1 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:02:05.633883 ip-10-0-142-1 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 01:02:05.633883 ip-10-0-142-1 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:02:05.633883 ip-10-0-142-1 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 01:02:05.633883 ip-10-0-142-1 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 01:02:05.636122 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.636025 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 01:02:05.643930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643905 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:02:05.643930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643926 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:02:05.643930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643931 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:02:05.643930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643934 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:02:05.643930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643937 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:02:05.643930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643940 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643943 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643946 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643949 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643952 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643956 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643959 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643961 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643964 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643967 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643969 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643972 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643975 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643978 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643980 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643984 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643989 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643992 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643995 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:02:05.644173 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.643998 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644001 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644004 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644008 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644011 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644015 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644018 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644022 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644026 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644029 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644033 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644037 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644041 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644044 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644047 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644050 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644053 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644056 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644058 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:02:05.644642 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644061 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644064 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644067 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644070 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644087 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644090 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644093 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644095 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644098 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644101 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644104 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644107 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644110 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644113 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644115 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644118 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644120 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644123 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644126 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644128 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:02:05.645184 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644131 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644133 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644136 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644139 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644141 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644144 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644146 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644149 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644152 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644155 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644158 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644160 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644163 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644165 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644168 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644171 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644173 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644176 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644179 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:02:05.645662 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644181 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644186 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644189 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644191 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644194 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644196 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644199 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644202 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644205 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644208 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644210 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644214 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644218 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644222 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644225 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644228 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.644231 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645011 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645019 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:02:05.646150 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645023 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645027 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645031 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645035 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645038 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645040 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645043 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645046 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645049 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645052 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645055 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645057 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645060 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645063 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645066 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645069 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645088 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645093 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645097 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:02:05.646605 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645101 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645104 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645108 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645110 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645113 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645116 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645118 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645122 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645125 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645128 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645130 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645133 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645135 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645138 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645141 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645143 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645146 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645149 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645151 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645154 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:02:05.647090 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645157 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645159 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645162 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645165 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645168 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645170 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645173 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645175 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645178 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645181 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645184 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645187 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645189 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645193 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645196 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645198 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645201 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645204 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645207 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645210 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:02:05.647583 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645212 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645215 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645218 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645222 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645224 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645227 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645230 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645234 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645236 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645239 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645242 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645245 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645248 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645250 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645253 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645256 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645259 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645261 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645264 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645266 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:02:05.648087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645268 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645271 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645275 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645277 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645279 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645282 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645285 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645287 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645290 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645292 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645295 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645297 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645300 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645302 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645305 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645307 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645309 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645312 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645693 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645698 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:02:05.648571 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645700 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645703 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645705 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645708 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645711 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645713 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645716 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645718 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645721 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645724 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645726 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645729 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645731 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645735 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645738 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645741 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645744 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645747 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645749 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645752 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:02:05.649092 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645754 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645756 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645759 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645761 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645764 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645766 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645769 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645772 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645775 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645779 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645782 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645785 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645788 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645790 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645793 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645795 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645798 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645800 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645803 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645805 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:02:05.649611 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645808 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645811 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645814 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645816 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645819 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645822 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645824 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645828 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645830 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645832 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645837 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645840 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645843 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645846 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645848 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645856 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645859 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645861 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645864 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:02:05.650137 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645866 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645869 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645871 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645874 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645877 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645879 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645882 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645886 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645890 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645892 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645895 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645898 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645900 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645903 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645905 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645908 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645911 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645913 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645917 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645919 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:02:05.650604 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645922 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645925 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645927 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645930 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645932 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645935 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645937 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645940 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645944 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645946 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645949 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645951 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645954 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645957 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645959 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645962 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645964 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.645967 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646037 2554 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646044 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646053 2554 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 01:02:05.651104 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646060 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646066 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646071 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646093 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646098 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646102 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646105 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646108 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646112 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646116 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646119 2554 flags.go:64] FLAG: --cgroup-root="" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646122 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646125 2554 flags.go:64] FLAG: --client-ca-file="" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646128 2554 flags.go:64] FLAG: --cloud-provider="external" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646131 2554 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646136 2554 flags.go:64] FLAG: --cluster-domain="" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646139 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646142 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646146 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646150 2554 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646154 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646157 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646160 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 01:02:05.651648 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646164 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646167 2554 flags.go:64] FLAG: --contention-profiling="false" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646170 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646173 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646177 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646179 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646184 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646187 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646190 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646193 2554 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646196 2554 flags.go:64] FLAG: --enable-server="true" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646199 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646205 2554 flags.go:64] FLAG: --event-burst="100" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646208 2554 flags.go:64] FLAG: --event-qps="50" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646211 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646214 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646217 2554 flags.go:64] FLAG: --eviction-hard="" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646225 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646229 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646232 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646235 2554 flags.go:64] FLAG: --eviction-soft="" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646238 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646241 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646244 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646247 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 01:02:05.652214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646250 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646253 2554 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646256 2554 flags.go:64] FLAG: --feature-gates="" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646261 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646264 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646267 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646270 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646273 2554 flags.go:64] FLAG: --healthz-port="10248" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646276 2554 flags.go:64] FLAG: --help="false" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646279 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646282 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646285 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646288 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646291 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646294 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646298 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646300 2554 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646303 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646306 2554 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646309 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646312 2554 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646315 2554 flags.go:64] FLAG: --kube-reserved="" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646318 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646321 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 01:02:05.652851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646324 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646328 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646331 2554 flags.go:64] FLAG: --lock-file="" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646334 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646337 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646339 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646345 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646348 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646351 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646354 2554 flags.go:64] FLAG: --logging-format="text" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646357 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646362 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646365 2554 flags.go:64] FLAG: --manifest-url="" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646368 2554 flags.go:64] FLAG: --manifest-url-header="" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646372 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646375 2554 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646379 2554 flags.go:64] FLAG: --max-pods="110" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646382 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646385 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646388 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646391 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646394 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646397 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646400 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646408 2554 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 01:02:05.653487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646411 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646414 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646417 2554 flags.go:64] FLAG: --pod-cidr="" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646420 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646426 2554 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646429 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646432 2554 flags.go:64] FLAG: --pods-per-core="0" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646435 2554 flags.go:64] FLAG: --port="10250" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646439 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646442 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-087d249e910605a05" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646445 2554 flags.go:64] FLAG: --qos-reserved="" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646448 2554 flags.go:64] FLAG: --read-only-port="10255" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646451 2554 flags.go:64] FLAG: --register-node="true" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646453 2554 flags.go:64] FLAG: --register-with-taints="" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646457 2554 flags.go:64] FLAG: --registry-burst="10" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646461 2554 flags.go:64] FLAG: --registry-qps="5" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646463 2554 flags.go:64] FLAG: --reserved-cpus="" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646466 2554 flags.go:64] FLAG: --reserved-memory="" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646470 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646475 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646478 2554 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646481 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646483 2554 flags.go:64] FLAG: --runonce="false" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646486 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646489 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 01:02:05.654118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646492 2554 flags.go:64] FLAG: --seccomp-default="false" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646495 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646498 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646501 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646504 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646507 2554 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646510 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646513 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646515 2554 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646518 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646521 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646524 2554 flags.go:64] FLAG: --system-cgroups="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646527 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646532 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646535 2554 flags.go:64] FLAG: --tls-cert-file="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646539 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646543 2554 flags.go:64] FLAG: --tls-min-version="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646546 2554 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646549 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646552 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646554 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646557 2554 flags.go:64] FLAG: --v="2" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646561 2554 flags.go:64] FLAG: --version="false" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646566 2554 flags.go:64] FLAG: --vmodule="" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646570 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 01:02:05.654724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.646573 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646691 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646695 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646698 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646701 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646704 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646707 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646710 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646713 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646715 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646718 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646720 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646723 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646726 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646728 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646731 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646733 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646736 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646739 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:02:05.655354 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646741 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646744 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646747 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646751 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646754 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646775 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646779 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646782 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646786 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646789 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646791 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646794 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646797 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646800 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646804 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646806 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646809 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646812 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646814 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:02:05.655815 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646817 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646819 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646822 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646824 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646827 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646830 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646832 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646835 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646837 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646840 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646842 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646845 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646847 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646849 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646852 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646855 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646858 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646861 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646864 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646866 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:02:05.656303 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646869 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646871 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646874 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646876 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646879 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646881 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646886 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646891 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646894 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646897 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646901 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646904 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646907 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646910 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646912 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646915 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646918 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646920 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646923 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:02:05.656819 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646925 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646928 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646931 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646933 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646936 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646938 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646941 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646943 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646946 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646952 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646955 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646958 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646960 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646963 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646965 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646968 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646970 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646973 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646975 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646978 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:02:05.657341 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646981 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646984 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.646986 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.647660 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.654465 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.654571 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.654592 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.654598 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654654 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654660 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654663 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654666 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654670 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654675 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:02:05.657865 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654678 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654681 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654684 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654686 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654689 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654693 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654697 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654700 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654703 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654707 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654710 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654713 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654716 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654719 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654721 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654724 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654726 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654729 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654732 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:02:05.658240 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654735 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654738 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654741 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654743 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654747 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654750 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654753 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654756 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654758 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654761 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654764 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654766 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654769 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654772 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654774 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654777 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654779 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654782 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654785 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654787 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:02:05.658731 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654790 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654792 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654795 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654797 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654800 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654803 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654806 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654808 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654811 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654814 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654816 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654818 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654821 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654823 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654826 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654829 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654832 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654835 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654837 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654842 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:02:05.659249 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654845 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654848 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654851 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654854 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654856 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654859 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654861 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654864 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654866 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654868 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654871 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654873 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654876 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654878 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654882 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654885 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654887 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654889 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654892 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654894 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:02:05.659753 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654897 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654900 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654902 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654905 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654907 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654910 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654912 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654915 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654917 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654920 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654923 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654926 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654928 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.654930 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.654936 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:02:05.660638 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655048 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655052 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655055 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655058 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655061 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655063 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655066 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655068 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655071 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655088 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655090 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655093 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655096 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655098 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655101 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655104 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655106 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655109 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655112 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655114 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 01:02:05.661162 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655117 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655119 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655122 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655124 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655127 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655130 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655132 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655135 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655143 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655145 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655148 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655151 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655154 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655156 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655159 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655163 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655167 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655170 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655172 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 01:02:05.661682 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655175 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655178 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655180 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655182 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655185 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655188 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655190 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655194 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655196 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655199 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655202 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655205 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655207 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655210 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655213 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655215 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655218 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655220 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655223 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655225 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 01:02:05.662153 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655228 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655230 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655234 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655236 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655240 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655243 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655246 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655249 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655252 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655254 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655257 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655259 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655262 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655264 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655267 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655270 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655272 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655275 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655277 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 01:02:05.662834 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655280 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655283 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655285 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655288 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655290 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655293 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655296 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655298 2554 feature_gate.go:328] unrecognized feature gate: Example Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655301 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655303 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655307 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655310 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655313 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655315 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655318 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655321 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655324 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655326 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655329 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655331 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 01:02:05.663380 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:05.655334 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.655339 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.655453 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.658158 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.659673 2554 server.go:1019] "Starting client certificate rotation" Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.659781 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.659860 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 01:02:05.664244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.662738 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:02:05.665044 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.664733 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 01:02:05.681310 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.681286 2554 log.go:25] "Validated CRI v1 runtime API" Jun 10 01:02:05.683830 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.683814 2554 log.go:25] "Validated CRI v1 image API" Jun 10 01:02:05.684664 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.684650 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 01:02:05.695113 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.695092 2554 fs.go:135] Filesystem UUIDs: map[09e9101d-85ee-44f7-ae6a-49118b2de693:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b4714e18-ffb2-4de6-8445-000ec65b03e9:/dev/nvme0n1p4] Jun 10 01:02:05.695176 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.695112 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 01:02:05.696020 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.695993 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:02:05.701612 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.701500 2554 manager.go:216] Machine: {Timestamp:2026-06-10 01:02:05.698728575 +0000 UTC m=+0.424330901 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100578 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20abdb2eed003d5e3e82ca5e8ac0ab SystemUUID:ec20abdb-2eed-003d-5e3e-82ca5e8ac0ab BootID:58cb42e8-c3c5-4e77-82db-3adcba82624c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:0f:b8:04:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:0f:b8:04:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:47:b8:0c:ea:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 01:02:05.701612 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.701607 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 01:02:05.701719 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.701690 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 01:02:05.703268 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.703245 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 01:02:05.703402 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.703271 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 01:02:05.704697 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.704686 2554 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 01:02:05.704745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.704699 2554 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 01:02:05.704745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.704707 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:02:05.705478 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.705467 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 01:02:05.706354 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.706344 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 01:02:05.709560 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709549 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:02:05.709668 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709659 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 01:02:05.709699 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709689 2554 kubelet.go:486] "Attempting to sync node with API server" Jun 10 01:02:05.709734 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709699 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 01:02:05.709734 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709716 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 01:02:05.709734 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709726 2554 kubelet.go:398] "Adding apiserver pod source" Jun 10 01:02:05.709845 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.709736 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 01:02:05.710125 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.710113 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:02:05.710176 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.710132 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 01:02:05.712843 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.712809 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 01:02:05.714823 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.714807 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 01:02:05.714873 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.714840 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 01:02:05.716021 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716008 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716024 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716031 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716037 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716050 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716058 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716066 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 01:02:05.716096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716086 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 01:02:05.716287 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716105 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 01:02:05.716287 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716112 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 01:02:05.716287 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716121 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 01:02:05.716287 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.716126 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 01:02:05.717205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.717194 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 01:02:05.717205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.717204 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 01:02:05.720440 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.720425 2554 server.go:1268] "Started kubelet" Jun 10 01:02:05.720558 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.720531 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 01:02:05.720625 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.720572 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 01:02:05.720625 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.720569 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 01:02:05.720738 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.720656 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 01:02:05.720738 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.720668 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 01:02:05.720830 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.720786 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 01:02:05.721380 ip-10-0-142-1 systemd[1]: Started Kubernetes Kubelet. Jun 10 01:02:05.723732 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.723702 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 01:02:05.724974 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.724952 2554 server.go:310] "Adding debug handlers to kubelet server" Jun 10 01:02:05.728050 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.728030 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xjnd7" Jun 10 01:02:05.730282 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.729154 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-1.ec2.internal.18b792903597b788 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-1.ec2.internal,UID:ip-10-0-142-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-1.ec2.internal,},FirstTimestamp:2026-06-10 01:02:05.7204018 +0000 UTC m=+0.446004107,LastTimestamp:2026-06-10 01:02:05.7204018 +0000 UTC m=+0.446004107,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-1.ec2.internal,}" Jun 10 01:02:05.730517 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.730499 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 01:02:05.730617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.730503 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 01:02:05.730678 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.730614 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:05.730768 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.730736 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 01:02:05.731195 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731065 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 01:02:05.731491 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731471 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 01:02:05.731571 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731522 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 01:02:05.731678 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731659 2554 reconstruct.go:97] "Volume reconstruction finished" Jun 10 01:02:05.731678 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731674 2554 reconciler.go:29] "Reconciler: start to sync state" Jun 10 01:02:05.731818 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731769 2554 factory.go:55] Registering systemd factory Jun 10 01:02:05.731818 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731786 2554 factory.go:223] Registration of the systemd container factory successfully Jun 10 01:02:05.731986 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731974 2554 factory.go:153] Registering CRI-O factory Jun 10 01:02:05.732025 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.731989 2554 factory.go:223] Registration of the crio container factory successfully Jun 10 01:02:05.732089 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.732039 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 01:02:05.732089 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.732064 2554 factory.go:103] Registering Raw factory Jun 10 01:02:05.732239 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.732101 2554 manager.go:1196] Started watching for new ooms in manager Jun 10 01:02:05.733028 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.732931 2554 manager.go:349] Starting recovery of all containers Jun 10 01:02:05.735520 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.735494 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xjnd7" Jun 10 01:02:05.736599 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.736573 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 01:02:05.736702 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.736681 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 01:02:05.738920 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.738885 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 01:02:05.743296 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.743279 2554 manager.go:354] Recovery completed Jun 10 01:02:05.747316 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.747246 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.755036 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755019 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.755131 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755049 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.755131 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755059 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.755625 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755607 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 01:02:05.755625 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755623 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 01:02:05.755625 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755627 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.755779 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.755638 2554 state_mem.go:36] "Initialized new in-memory state store" Jun 10 01:02:05.756459 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.756443 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.756543 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.756473 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.756543 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.756486 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.757004 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.756986 2554 policy_none.go:49] "None policy: Start" Jun 10 01:02:05.757056 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.757016 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 01:02:05.757056 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.757034 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 01:02:05.757531 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.757455 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-1.ec2.internal.18b7929037a82e16 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-1.ec2.internal,UID:ip-10-0-142-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-1.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-1.ec2.internal,},FirstTimestamp:2026-06-10 01:02:05.755035158 +0000 UTC m=+0.480637466,LastTimestamp:2026-06-10 01:02:05.755035158 +0000 UTC m=+0.480637466,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-1.ec2.internal,}" Jun 10 01:02:05.758194 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.758179 2554 policy_none.go:47] "Start" Jun 10 01:02:05.799661 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.799642 2554 manager.go:337] "Starting Device Plugin manager" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.799705 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.799719 2554 server.go:87] "Starting device plugin registration server" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.799975 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.799987 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.800105 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.800186 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.800194 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.800969 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.801020 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.810725 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.810759 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.810777 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 01:02:05.811725 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.810847 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 01:02:05.812726 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.812699 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:02:05.900760 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.900726 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.901667 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.901652 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.901741 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.901680 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.901741 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.901692 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.901741 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.901715 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.909864 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.909848 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.909905 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.909873 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-1.ec2.internal\": node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:05.910946 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.910930 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal"] Jun 10 01:02:05.911000 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.910990 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.911811 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.911797 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.911866 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.911825 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.911866 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.911838 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.913189 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913174 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.913319 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913301 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.913359 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913340 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.913798 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913784 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.913865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913813 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.913865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913827 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.913930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913863 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.913930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913881 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.913930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.913894 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.914882 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.914865 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.914882 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.914886 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 01:02:05.915477 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.915461 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientMemory" Jun 10 01:02:05.915553 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.915486 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 01:02:05.915553 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.915499 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeHasSufficientPID" Jun 10 01:02:05.921864 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.921845 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:05.933116 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.933093 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21cae4f3fc4c083932a454cb018ce02d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal\" (UID: \"21cae4f3fc4c083932a454cb018ce02d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.933191 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.933123 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cae4f3fc4c083932a454cb018ce02d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal\" (UID: \"21cae4f3fc4c083932a454cb018ce02d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.933191 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:05.933149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c77efe5dbb10bf49d407d2dcd67c5a4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-1.ec2.internal\" (UID: \"7c77efe5dbb10bf49d407d2dcd67c5a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.945823 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.945808 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-1.ec2.internal\" not found" node="ip-10-0-142-1.ec2.internal" Jun 10 01:02:05.950468 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:05.950454 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-1.ec2.internal\" not found" node="ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.022197 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.022173 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.033283 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.033260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21cae4f3fc4c083932a454cb018ce02d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal\" (UID: \"21cae4f3fc4c083932a454cb018ce02d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.033351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.033288 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cae4f3fc4c083932a454cb018ce02d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal\" (UID: \"21cae4f3fc4c083932a454cb018ce02d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.033351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.033307 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c77efe5dbb10bf49d407d2dcd67c5a4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-1.ec2.internal\" (UID: \"7c77efe5dbb10bf49d407d2dcd67c5a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.033351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.033346 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c77efe5dbb10bf49d407d2dcd67c5a4-config\") pod \"kube-apiserver-proxy-ip-10-0-142-1.ec2.internal\" (UID: \"7c77efe5dbb10bf49d407d2dcd67c5a4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.033459 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.033374 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/21cae4f3fc4c083932a454cb018ce02d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal\" (UID: \"21cae4f3fc4c083932a454cb018ce02d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.033459 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.033376 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/21cae4f3fc4c083932a454cb018ce02d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal\" (UID: \"21cae4f3fc4c083932a454cb018ce02d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.122954 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.122914 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.223818 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.223749 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.250266 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.250241 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.255982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.255964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.324900 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.324864 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.425410 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.425380 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.525956 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.525868 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.626443 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.626415 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.658936 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.658908 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 01:02:06.659576 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.659066 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 01:02:06.722996 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:06.722960 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c77efe5dbb10bf49d407d2dcd67c5a4.slice/crio-a60e5776cbbd1f7c04d798dac7d43b89e5ae03358bfd102bdf7e738971e7cdd5 WatchSource:0}: Error finding container a60e5776cbbd1f7c04d798dac7d43b89e5ae03358bfd102bdf7e738971e7cdd5: Status 404 returned error can't find the container with id a60e5776cbbd1f7c04d798dac7d43b89e5ae03358bfd102bdf7e738971e7cdd5 Jun 10 01:02:06.727110 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.727091 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.729147 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.729133 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:02:06.738700 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.738674 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 00:57:05 +0000 UTC" deadline="2028-02-16 05:32:10.54880291 +0000 UTC" Jun 10 01:02:06.738700 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.738698 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14788h30m3.810107324s" Jun 10 01:02:06.768919 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.768891 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:02:06.814225 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.813970 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" event={"ID":"7c77efe5dbb10bf49d407d2dcd67c5a4","Type":"ContainerStarted","Data":"a60e5776cbbd1f7c04d798dac7d43b89e5ae03358bfd102bdf7e738971e7cdd5"} Jun 10 01:02:06.828150 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:06.828113 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-1.ec2.internal\" not found" Jun 10 01:02:06.923947 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.923921 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:02:06.931633 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.931615 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.941833 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.941816 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:02:06.943600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.943587 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" Jun 10 01:02:06.950977 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:06.950963 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 01:02:07.110536 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.110455 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:02:07.620644 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.620614 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 01:02:07.710863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.710829 2554 apiserver.go:52] "Watching apiserver" Jun 10 01:02:07.717952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.717919 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 01:02:07.718794 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.718772 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-rmln5","openshift-multus/multus-tkxfw","openshift-multus/network-metrics-daemon-vbrdw","openshift-network-diagnostics/network-check-target-5scqc","openshift-network-operator/iptables-alerter-wmdwx","kube-system/konnectivity-agent-xxzpx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4","openshift-cluster-node-tuning-operator/tuned-tjsmv","openshift-dns/node-resolver-2ps6g","openshift-image-registry/node-ca-2tpq7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-nsl45","kube-system/global-pull-secret-syncer-9n2dh","kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal"] Jun 10 01:02:07.720362 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.720342 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.721430 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.721411 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.722466 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.722446 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ss2ch\"" Jun 10 01:02:07.722593 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.722471 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.722686 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.722666 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.722739 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.722667 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 01:02:07.722833 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.722811 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:07.722950 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.722889 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:07.723822 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.723642 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 01:02:07.723822 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.723696 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.723822 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.723758 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cttd9\"" Jun 10 01:02:07.724689 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.723884 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 01:02:07.724689 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.724279 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.724803 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.724783 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.725018 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.724999 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.726065 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.726038 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.726174 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.726121 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.726306 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.726288 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.726699 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.726558 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-658fx\"" Jun 10 01:02:07.726950 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.726933 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 01:02:07.727048 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.726994 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ctk7h\"" Jun 10 01:02:07.727048 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.727039 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.727235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.727220 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.727395 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.727377 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.728160 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.728141 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 01:02:07.728253 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.728145 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 01:02:07.728481 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.728462 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pgh54\"" Jun 10 01:02:07.728772 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.728749 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.729572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.729487 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 01:02:07.729684 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.729667 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 01:02:07.729810 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.729790 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t5jmc\"" Jun 10 01:02:07.730090 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.729895 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.730090 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.729950 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:07.730600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.730581 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.731149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.730892 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.731149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.730906 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 01:02:07.731149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.730936 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zpcd7\"" Jun 10 01:02:07.731149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.730991 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 01:02:07.731149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.731133 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.732555 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.732534 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.733118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.733100 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6bfh8\"" Jun 10 01:02:07.733118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.733112 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.733263 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.733114 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.734225 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.734208 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:07.734324 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.734265 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:07.735262 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.734986 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 01:02:07.735353 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.735303 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 01:02:07.735554 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.735537 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 01:02:07.735641 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.735560 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j7frh\"" Jun 10 01:02:07.735641 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.735576 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 01:02:07.735909 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.735890 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 01:02:07.736019 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.735988 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 01:02:07.742278 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkdkw\" (UniqueName: \"kubernetes.io/projected/47ff70a7-107b-4b1d-a602-11b1b3dd6050-kube-api-access-lkdkw\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.742369 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742288 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cnibin\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.742369 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742310 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-kubernetes\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.742369 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-systemd\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.742564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742385 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61690ee4-93d0-424d-b3aa-92962ffcebb6-kubelet-config\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.742564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbn9d\" (UniqueName: \"kubernetes.io/projected/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-kube-api-access-nbn9d\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.742564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:07.742564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742513 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjfj6\" (UniqueName: \"kubernetes.io/projected/9a7de745-ffdf-4b32-a818-7c023c9a0633-kube-api-access-pjfj6\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:07.742564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742553 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-system-cni-dir\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.742564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742577 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742640 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-netns\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742674 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysconfig\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/921cf87a-a947-4670-94a0-af969c870dce-konnectivity-ca\") pod \"konnectivity-agent-xxzpx\" (UID: \"921cf87a-a947-4670-94a0-af969c870dce\") " pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742738 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742828 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-lib-modules\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.742897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742875 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742870 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-host\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.742972 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-device-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-run-netns\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-systemd\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-log-socket\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr9xz\" (UniqueName: \"kubernetes.io/projected/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-kube-api-access-pr9xz\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743166 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-cni-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.743215 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743214 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-multus-certs\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743262 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-socket-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743288 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2cp4\" (UniqueName: \"kubernetes.io/projected/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-kube-api-access-w2cp4\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47ff70a7-107b-4b1d-a602-11b1b3dd6050-host\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743333 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afb9cf85-3d40-405a-992d-67533fcd33b5-host-slash\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743361 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/921cf87a-a947-4670-94a0-af969c870dce-agent-certs\") pod \"konnectivity-agent-xxzpx\" (UID: \"921cf87a-a947-4670-94a0-af969c870dce\") " pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vljhn\" (UniqueName: \"kubernetes.io/projected/c4955bc9-a85f-470b-8144-146354d0854b-kube-api-access-vljhn\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743432 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-conf-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743460 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-node-log\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743472 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-env-overrides\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743499 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovnkube-script-lib\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743532 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afb9cf85-3d40-405a-992d-67533fcd33b5-iptables-alerter-script\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743558 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzs2\" (UniqueName: \"kubernetes.io/projected/afb9cf85-3d40-405a-992d-67533fcd33b5-kube-api-access-lwzs2\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.743595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-var-lib-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743610 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovnkube-config\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-os-release\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743668 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-cnibin\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-cni-multus\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743729 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-run\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743802 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-cni-bin\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743815 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-os-release\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3e75149-d033-4820-9b04-8d9f9c3a2614-cni-binary-copy\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743863 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-socket-dir-parent\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743876 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysctl-conf\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743911 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-tmp-dir\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743932 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-slash\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743976 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovn-node-metrics-cert\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.743999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-modprobe-d\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c24c65-723d-4641-b7b4-782b70049b7e-tmp\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744258 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744031 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-etc-selinux\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744070 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-cni-netd\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744148 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-hostroot\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744168 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-hosts-file\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744207 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysctl-d\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744228 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-var-lib-kubelet\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744275 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47ff70a7-107b-4b1d-a602-11b1b3dd6050-serviceca\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744329 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-daemon-config\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744362 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-sys\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744391 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-tuned\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744424 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf9t7\" (UniqueName: \"kubernetes.io/projected/f3e75149-d033-4820-9b04-8d9f9c3a2614-kube-api-access-wf9t7\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744452 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-kubelet\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744496 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-system-cni-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744526 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-kubelet\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsld5\" (UniqueName: \"kubernetes.io/projected/b6c24c65-723d-4641-b7b4-782b70049b7e-kube-api-access-zsld5\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.744956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-systemd-units\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744614 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-ovn\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744637 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744669 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-k8s-cni-cncf-io\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61690ee4-93d0-424d-b3aa-92962ffcebb6-dbus\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744778 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-cni-bin\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744814 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-etc-kubernetes\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744839 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744874 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-registration-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-sys-fs\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.746109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.744934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-etc-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.762926 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.762904 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nc544" Jun 10 01:02:07.768864 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.768845 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nc544" Jun 10 01:02:07.832745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.832703 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 01:02:07.845618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845589 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845628 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-cni-bin\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-os-release\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845679 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3e75149-d033-4820-9b04-8d9f9c3a2614-cni-binary-copy\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-socket-dir-parent\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845710 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysctl-conf\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845720 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-cni-bin\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845749 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-tmp-dir\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-slash\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.845786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845766 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-os-release\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845795 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-socket-dir-parent\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845797 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovn-node-metrics-cert\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845841 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-modprobe-d\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845951 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysctl-conf\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.845979 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-slash\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846058 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-modprobe-d\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846106 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c24c65-723d-4641-b7b4-782b70049b7e-tmp\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-etc-selinux\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.846248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846239 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-cni-netd\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846285 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-tmp-dir\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846262 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846299 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-hostroot\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846324 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-hosts-file\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846382 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f3e75149-d033-4820-9b04-8d9f9c3a2614-cni-binary-copy\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846369 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-hostroot\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846451 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysctl-d\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846476 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-var-lib-kubelet\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846484 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-etc-selinux\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846517 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-cni-netd\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846530 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-hosts-file\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846574 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-var-lib-kubelet\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846613 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysctl-d\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846633 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47ff70a7-107b-4b1d-a602-11b1b3dd6050-serviceca\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.846657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846651 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846676 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846703 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-daemon-config\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846820 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846899 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-sys\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-tuned\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.846988 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf9t7\" (UniqueName: \"kubernetes.io/projected/f3e75149-d033-4820-9b04-8d9f9c3a2614-kube-api-access-wf9t7\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847025 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-kubelet\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-system-cni-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847071 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-kubelet\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsld5\" (UniqueName: \"kubernetes.io/projected/b6c24c65-723d-4641-b7b4-782b70049b7e-kube-api-access-zsld5\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847206 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-systemd-units\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-ovn\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847252 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-daemon-config\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847295 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-k8s-cni-cncf-io\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61690ee4-93d0-424d-b3aa-92962ffcebb6-dbus\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.847403 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847347 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-kubelet\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-cni-bin\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847379 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-etc-kubernetes\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847398 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-system-cni-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847046 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-sys\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847413 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847443 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-registration-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847469 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-sys-fs\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-etc-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkdkw\" (UniqueName: \"kubernetes.io/projected/47ff70a7-107b-4b1d-a602-11b1b3dd6050-kube-api-access-lkdkw\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847550 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/47ff70a7-107b-4b1d-a602-11b1b3dd6050-serviceca\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cnibin\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847625 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-kubernetes\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847680 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-sys-fs\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847737 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847777 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-k8s-cni-cncf-io\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847808 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-kubernetes\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.848197 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847824 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61690ee4-93d0-424d-b3aa-92962ffcebb6-dbus\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-systemd\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847874 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-cni-bin\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847913 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-kubelet\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847915 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61690ee4-93d0-424d-b3aa-92962ffcebb6-kubelet-config\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847924 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-registration-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbn9d\" (UniqueName: \"kubernetes.io/projected/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-kube-api-access-nbn9d\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847986 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-etc-kubernetes\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847992 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847997 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848018 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-systemd\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.847962 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-systemd-units\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjfj6\" (UniqueName: \"kubernetes.io/projected/9a7de745-ffdf-4b32-a818-7c023c9a0633-kube-api-access-pjfj6\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848110 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-system-cni-dir\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.848155 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848175 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-etc-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-netns\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.849051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848213 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-netns\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848225 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysconfig\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848292 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/921cf87a-a947-4670-94a0-af969c870dce-konnectivity-ca\") pod \"konnectivity-agent-xxzpx\" (UID: \"921cf87a-a947-4670-94a0-af969c870dce\") " pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.848334 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:08.348297066 +0000 UTC m=+3.073899375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848329 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-system-cni-dir\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848375 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848402 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-sysconfig\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848507 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61690ee4-93d0-424d-b3aa-92962ffcebb6-kubelet-config\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848667 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848681 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848845 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-lib-modules\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-host\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-device-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848922 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-run-netns\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848928 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-lib-modules\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.849905 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-systemd\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848968 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-log-socket\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848982 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-host\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr9xz\" (UniqueName: \"kubernetes.io/projected/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-kube-api-access-pr9xz\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849010 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-host-run-netns\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849019 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-cni-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849026 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-device-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-multus-certs\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848849 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/921cf87a-a947-4670-94a0-af969c870dce-konnectivity-ca\") pod \"konnectivity-agent-xxzpx\" (UID: \"921cf87a-a947-4670-94a0-af969c870dce\") " pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849071 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-systemd\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849092 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-log-socket\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.848850 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-socket-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849140 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-run-multus-certs\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849158 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2cp4\" (UniqueName: \"kubernetes.io/projected/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-kube-api-access-w2cp4\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849177 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cni-binary-copy\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47ff70a7-107b-4b1d-a602-11b1b3dd6050-host\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849206 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-cni-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.850683 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afb9cf85-3d40-405a-992d-67533fcd33b5-host-slash\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849245 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/47ff70a7-107b-4b1d-a602-11b1b3dd6050-host\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849262 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/921cf87a-a947-4670-94a0-af969c870dce-agent-certs\") pod \"konnectivity-agent-xxzpx\" (UID: \"921cf87a-a947-4670-94a0-af969c870dce\") " pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849328 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-cnibin\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vljhn\" (UniqueName: \"kubernetes.io/projected/c4955bc9-a85f-470b-8144-146354d0854b-kube-api-access-vljhn\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849469 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/afb9cf85-3d40-405a-992d-67533fcd33b5-host-slash\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-conf-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-node-log\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849553 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c4955bc9-a85f-470b-8144-146354d0854b-socket-dir\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849577 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-multus-conf-dir\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.849605 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849624 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-node-log\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849666 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-env-overrides\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.849689 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:08.34967081 +0000 UTC m=+3.075273114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849732 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-run-ovn\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849830 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovnkube-script-lib\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.851489 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afb9cf85-3d40-405a-992d-67533fcd33b5-iptables-alerter-script\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849882 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzs2\" (UniqueName: \"kubernetes.io/projected/afb9cf85-3d40-405a-992d-67533fcd33b5-kube-api-access-lwzs2\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-var-lib-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849942 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovnkube-config\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-os-release\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.849993 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-cnibin\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850032 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-cni-multus\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850056 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-run\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850173 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b6c24c65-723d-4641-b7b4-782b70049b7e-run\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850242 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-env-overrides\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovn-node-metrics-cert\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850551 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovnkube-script-lib\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850666 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-os-release\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/afb9cf85-3d40-405a-992d-67533fcd33b5-iptables-alerter-script\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850718 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-cnibin\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850787 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-var-lib-openvswitch\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.850823 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f3e75149-d033-4820-9b04-8d9f9c3a2614-host-var-lib-cni-multus\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.851168 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-ovnkube-config\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.852186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.851927 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6c24c65-723d-4641-b7b4-782b70049b7e-tmp\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.853013 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.851962 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b6c24c65-723d-4641-b7b4-782b70049b7e-etc-tuned\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.853591 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.853567 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/921cf87a-a947-4670-94a0-af969c870dce-agent-certs\") pod \"konnectivity-agent-xxzpx\" (UID: \"921cf87a-a947-4670-94a0-af969c870dce\") " pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:07.856341 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.855811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf9t7\" (UniqueName: \"kubernetes.io/projected/f3e75149-d033-4820-9b04-8d9f9c3a2614-kube-api-access-wf9t7\") pod \"multus-tkxfw\" (UID: \"f3e75149-d033-4820-9b04-8d9f9c3a2614\") " pod="openshift-multus/multus-tkxfw" Jun 10 01:02:07.857454 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.857429 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2cp4\" (UniqueName: \"kubernetes.io/projected/7b0f4ee2-8241-47aa-9e9f-e47769fa3cee-kube-api-access-w2cp4\") pod \"node-resolver-2ps6g\" (UID: \"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee\") " pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:07.860264 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.860242 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzs2\" (UniqueName: \"kubernetes.io/projected/afb9cf85-3d40-405a-992d-67533fcd33b5-kube-api-access-lwzs2\") pod \"iptables-alerter-wmdwx\" (UID: \"afb9cf85-3d40-405a-992d-67533fcd33b5\") " pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:07.860354 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.860331 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr9xz\" (UniqueName: \"kubernetes.io/projected/7c8040b5-a04e-4bc9-95aa-c5e64c5425b4-kube-api-access-pr9xz\") pod \"multus-additional-cni-plugins-rmln5\" (UID: \"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4\") " pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:07.860420 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.860351 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vljhn\" (UniqueName: \"kubernetes.io/projected/c4955bc9-a85f-470b-8144-146354d0854b-kube-api-access-vljhn\") pod \"aws-ebs-csi-driver-node-825f4\" (UID: \"c4955bc9-a85f-470b-8144-146354d0854b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:07.860420 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.860375 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkdkw\" (UniqueName: \"kubernetes.io/projected/47ff70a7-107b-4b1d-a602-11b1b3dd6050-kube-api-access-lkdkw\") pod \"node-ca-2tpq7\" (UID: \"47ff70a7-107b-4b1d-a602-11b1b3dd6050\") " pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:07.860528 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.860442 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjfj6\" (UniqueName: \"kubernetes.io/projected/9a7de745-ffdf-4b32-a818-7c023c9a0633-kube-api-access-pjfj6\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:07.861589 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.861545 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbn9d\" (UniqueName: \"kubernetes.io/projected/243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa-kube-api-access-nbn9d\") pod \"ovnkube-node-nsl45\" (UID: \"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:07.861899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.861879 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsld5\" (UniqueName: \"kubernetes.io/projected/b6c24c65-723d-4641-b7b4-782b70049b7e-kube-api-access-zsld5\") pod \"tuned-tjsmv\" (UID: \"b6c24c65-723d-4641-b7b4-782b70049b7e\") " pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:07.951220 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:07.951175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:07.956302 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.956276 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:07.956302 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.956306 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:07.956467 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.956320 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:07.956467 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:07.956379 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:08.456362767 +0000 UTC m=+3.181965078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:08.034561 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.034521 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2tpq7" Jun 10 01:02:08.041727 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.041707 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-tkxfw" Jun 10 01:02:08.052358 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.052334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" Jun 10 01:02:08.057892 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.057871 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wmdwx" Jun 10 01:02:08.065663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.065644 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:08.072185 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.072160 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rmln5" Jun 10 01:02:08.078037 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.078019 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" Jun 10 01:02:08.082713 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.082694 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2ps6g" Jun 10 01:02:08.087746 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.087728 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:08.355325 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.355238 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:08.355325 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.355291 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:08.355525 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.355415 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:08.355525 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.355485 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:09.355464576 +0000 UTC m=+4.081066893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:08.355525 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.355498 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:08.355652 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.355556 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:09.355539029 +0000 UTC m=+4.081141341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:08.456562 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.456528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:08.456744 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.456647 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:08.456744 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.456661 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:08.456744 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.456671 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:08.456744 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:08.456736 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:09.456705779 +0000 UTC m=+4.182308095 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:08.479929 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.479893 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c8040b5_a04e_4bc9_95aa_c5e64c5425b4.slice/crio-53fc04a5f88890bd13dd82533204a366e58612309b87675194a65d537598879e WatchSource:0}: Error finding container 53fc04a5f88890bd13dd82533204a366e58612309b87675194a65d537598879e: Status 404 returned error can't find the container with id 53fc04a5f88890bd13dd82533204a366e58612309b87675194a65d537598879e Jun 10 01:02:08.485044 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.485008 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b0f4ee2_8241_47aa_9e9f_e47769fa3cee.slice/crio-b62ff75c8f16051eb1ba7e9b791c8e3569976dddb88c5fe3becc158f127de7c1 WatchSource:0}: Error finding container b62ff75c8f16051eb1ba7e9b791c8e3569976dddb88c5fe3becc158f127de7c1: Status 404 returned error can't find the container with id b62ff75c8f16051eb1ba7e9b791c8e3569976dddb88c5fe3becc158f127de7c1 Jun 10 01:02:08.485921 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.485897 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ff70a7_107b_4b1d_a602_11b1b3dd6050.slice/crio-6b304c52e93e6ad7df9a3c49f3a6e8d590d96e235f3863d67eb18c4e497123b1 WatchSource:0}: Error finding container 6b304c52e93e6ad7df9a3c49f3a6e8d590d96e235f3863d67eb18c4e497123b1: Status 404 returned error can't find the container with id 6b304c52e93e6ad7df9a3c49f3a6e8d590d96e235f3863d67eb18c4e497123b1 Jun 10 01:02:08.486699 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.486618 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod243fbb3f_7b42_4f46_ba8c_3ebfab6e90aa.slice/crio-120564c51368028c6794e6227697bf04ad3f9a34fec99fec22aa02626fd46b6a WatchSource:0}: Error finding container 120564c51368028c6794e6227697bf04ad3f9a34fec99fec22aa02626fd46b6a: Status 404 returned error can't find the container with id 120564c51368028c6794e6227697bf04ad3f9a34fec99fec22aa02626fd46b6a Jun 10 01:02:08.487529 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.487456 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e75149_d033_4820_9b04_8d9f9c3a2614.slice/crio-e0ecc7fd6fe90e80015a69c33aa01ca58f731790323126e742898faf9d72fb1a WatchSource:0}: Error finding container e0ecc7fd6fe90e80015a69c33aa01ca58f731790323126e742898faf9d72fb1a: Status 404 returned error can't find the container with id e0ecc7fd6fe90e80015a69c33aa01ca58f731790323126e742898faf9d72fb1a Jun 10 01:02:08.488881 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.488815 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921cf87a_a947_4670_94a0_af969c870dce.slice/crio-e57a13e077abbf7b823fb89fd1888eb2400d31d687a80f4ed9de50a7f505f694 WatchSource:0}: Error finding container e57a13e077abbf7b823fb89fd1888eb2400d31d687a80f4ed9de50a7f505f694: Status 404 returned error can't find the container with id e57a13e077abbf7b823fb89fd1888eb2400d31d687a80f4ed9de50a7f505f694 Jun 10 01:02:08.490239 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.490217 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4955bc9_a85f_470b_8144_146354d0854b.slice/crio-3bde7435add6d4706040442abeb52ce0b5aec1efe826f8ed1bba452139c00662 WatchSource:0}: Error finding container 3bde7435add6d4706040442abeb52ce0b5aec1efe826f8ed1bba452139c00662: Status 404 returned error can't find the container with id 3bde7435add6d4706040442abeb52ce0b5aec1efe826f8ed1bba452139c00662 Jun 10 01:02:08.490641 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.490616 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafb9cf85_3d40_405a_992d_67533fcd33b5.slice/crio-f97d2e5213e8698168ac7d533ed8a2f37ff220092012160514a9a9a1a0e981cf WatchSource:0}: Error finding container f97d2e5213e8698168ac7d533ed8a2f37ff220092012160514a9a9a1a0e981cf: Status 404 returned error can't find the container with id f97d2e5213e8698168ac7d533ed8a2f37ff220092012160514a9a9a1a0e981cf Jun 10 01:02:08.491613 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.491592 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c24c65_723d_4641_b7b4_782b70049b7e.slice/crio-407df86c2ee54cc890ce73a6f76038c7181b59444bffa5df86d333f5e9db1a08 WatchSource:0}: Error finding container 407df86c2ee54cc890ce73a6f76038c7181b59444bffa5df86d333f5e9db1a08: Status 404 returned error can't find the container with id 407df86c2ee54cc890ce73a6f76038c7181b59444bffa5df86d333f5e9db1a08 Jun 10 01:02:08.757473 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:08.757445 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21cae4f3fc4c083932a454cb018ce02d.slice/crio-483b39e8f687d233b1ad278dbdd01adfb2fd1d880732481f05ffd1bc428f53fa WatchSource:0}: Error finding container 483b39e8f687d233b1ad278dbdd01adfb2fd1d880732481f05ffd1bc428f53fa: Status 404 returned error can't find the container with id 483b39e8f687d233b1ad278dbdd01adfb2fd1d880732481f05ffd1bc428f53fa Jun 10 01:02:08.771042 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.771013 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:57:07 +0000 UTC" deadline="2028-01-26 11:24:27.696672456 +0000 UTC" Jun 10 01:02:08.771042 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.771042 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14290h22m18.925634551s" Jun 10 01:02:08.819086 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.819028 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerStarted","Data":"53fc04a5f88890bd13dd82533204a366e58612309b87675194a65d537598879e"} Jun 10 01:02:08.824569 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.824532 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" event={"ID":"7c77efe5dbb10bf49d407d2dcd67c5a4","Type":"ContainerStarted","Data":"3f92a76440723e764c7f6f417f8d92bbfea30f1fe024b7422561ffd6dbf18381"} Jun 10 01:02:08.825892 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.825854 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" event={"ID":"21cae4f3fc4c083932a454cb018ce02d","Type":"ContainerStarted","Data":"483b39e8f687d233b1ad278dbdd01adfb2fd1d880732481f05ffd1bc428f53fa"} Jun 10 01:02:08.827001 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.826980 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" event={"ID":"b6c24c65-723d-4641-b7b4-782b70049b7e","Type":"ContainerStarted","Data":"407df86c2ee54cc890ce73a6f76038c7181b59444bffa5df86d333f5e9db1a08"} Jun 10 01:02:08.828275 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.828250 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"120564c51368028c6794e6227697bf04ad3f9a34fec99fec22aa02626fd46b6a"} Jun 10 01:02:08.829335 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.829310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wmdwx" event={"ID":"afb9cf85-3d40-405a-992d-67533fcd33b5","Type":"ContainerStarted","Data":"f97d2e5213e8698168ac7d533ed8a2f37ff220092012160514a9a9a1a0e981cf"} Jun 10 01:02:08.830506 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.830475 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" event={"ID":"c4955bc9-a85f-470b-8144-146354d0854b","Type":"ContainerStarted","Data":"3bde7435add6d4706040442abeb52ce0b5aec1efe826f8ed1bba452139c00662"} Jun 10 01:02:08.831481 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.831462 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xxzpx" event={"ID":"921cf87a-a947-4670-94a0-af969c870dce","Type":"ContainerStarted","Data":"e57a13e077abbf7b823fb89fd1888eb2400d31d687a80f4ed9de50a7f505f694"} Jun 10 01:02:08.832650 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.832624 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tkxfw" event={"ID":"f3e75149-d033-4820-9b04-8d9f9c3a2614","Type":"ContainerStarted","Data":"e0ecc7fd6fe90e80015a69c33aa01ca58f731790323126e742898faf9d72fb1a"} Jun 10 01:02:08.833712 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.833692 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2tpq7" event={"ID":"47ff70a7-107b-4b1d-a602-11b1b3dd6050","Type":"ContainerStarted","Data":"6b304c52e93e6ad7df9a3c49f3a6e8d590d96e235f3863d67eb18c4e497123b1"} Jun 10 01:02:08.834747 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:08.834727 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2ps6g" event={"ID":"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee","Type":"ContainerStarted","Data":"b62ff75c8f16051eb1ba7e9b791c8e3569976dddb88c5fe3becc158f127de7c1"} Jun 10 01:02:09.363775 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.363690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:09.363775 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.363758 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:09.363994 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.363895 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:09.363994 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.363971 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:11.363939245 +0000 UTC m=+6.089541540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:09.364472 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.364453 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:09.364573 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.364505 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:11.364491332 +0000 UTC m=+6.090093629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:09.464992 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.464951 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:09.465179 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.465136 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:09.465179 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.465159 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:09.465179 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.465173 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:09.465362 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.465245 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:11.465211968 +0000 UTC m=+6.190814266 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:09.772051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.771978 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 00:57:07 +0000 UTC" deadline="2028-03-15 12:28:32.777357032 +0000 UTC" Jun 10 01:02:09.772051 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.772016 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15467h26m23.005345903s" Jun 10 01:02:09.812026 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.811215 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:09.812026 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.811361 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:09.812026 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.811755 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:09.812026 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.811849 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:09.812026 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:09.811916 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:09.812026 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:09.811984 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:11.378860 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:11.378817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:11.379371 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:11.378887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:11.379371 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.379022 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:11.379371 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.379103 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:15.379067342 +0000 UTC m=+10.104669636 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:11.379545 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.379498 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:11.379593 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.379554 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:15.379536639 +0000 UTC m=+10.105138938 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:11.479499 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:11.479461 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:11.479684 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.479616 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:11.479684 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.479635 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:11.479684 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.479647 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:11.479841 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.479705 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:15.479686602 +0000 UTC m=+10.205288912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:11.812213 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:11.812028 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:11.812213 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:11.812034 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:11.812213 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.812184 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:11.812557 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:11.812223 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:11.812557 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.812343 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:11.812557 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:11.812421 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:13.811628 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:13.811159 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:13.811628 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:13.811301 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:13.811628 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:13.811395 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:13.811628 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:13.811406 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:13.811628 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:13.811504 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:13.811628 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:13.811595 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:15.414193 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:15.414109 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:15.414193 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:15.414172 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:15.414721 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.414338 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:15.414721 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.414406 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:23.414384862 +0000 UTC m=+18.139987158 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:15.414721 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.414468 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:15.414721 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.414503 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:23.414491967 +0000 UTC m=+18.140094266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:15.515617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:15.515564 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:15.515812 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.515796 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:15.515906 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.515821 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:15.515906 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.515834 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:15.515906 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.515903 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:23.515883211 +0000 UTC m=+18.241485508 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:15.813416 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:15.813341 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:15.813566 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.813452 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:15.813829 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:15.813809 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:15.813925 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.813902 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:15.813990 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:15.813968 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:15.814066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:15.814048 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:17.814545 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:17.814510 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:17.814984 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:17.814641 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:17.814984 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:17.814649 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:17.814984 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:17.814673 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:17.814984 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:17.814762 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:17.814984 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:17.814875 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:19.811029 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:19.810983 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:19.811495 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:19.811134 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:19.811495 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:19.811312 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:19.811495 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:19.811372 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:19.811495 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:19.811444 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:19.811702 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:19.811532 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:21.811031 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:21.810996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:21.811483 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:21.810996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:21.811483 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:21.811159 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:21.811483 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:21.811203 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:21.811483 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:21.811292 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:21.811483 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:21.811359 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:23.476413 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:23.476381 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:23.477066 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:23.476436 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:23.477066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.476527 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:23.477066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.476528 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:23.477066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.476592 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:39.476573795 +0000 UTC m=+34.202176094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:23.477066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.476612 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:39.476601256 +0000 UTC m=+34.202203563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:23.577642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:23.577608 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:23.577807 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.577731 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:23.577807 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.577746 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:23.577807 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.577755 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:23.577919 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.577810 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:02:39.577792123 +0000 UTC m=+34.303394439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:23.811667 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:23.811587 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:23.811814 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:23.811589 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:23.811814 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.811727 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:23.811814 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:23.811589 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:23.811814 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.811792 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:23.812041 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:23.811910 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:25.811737 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:25.811703 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:25.812206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:25.811803 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:25.812206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:25.811833 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:25.812206 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:25.811913 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:25.812206 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:25.811800 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:25.812206 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:25.812004 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:27.812166 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.811978 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:27.813133 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.811978 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:27.813133 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:27.812253 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:27.813133 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.812042 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:27.813133 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:27.812334 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:27.813133 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:27.812381 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:27.880706 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.880670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" event={"ID":"b6c24c65-723d-4641-b7b4-782b70049b7e","Type":"ContainerStarted","Data":"97a94b6739db436b685225a1a2a54769c81af7b99a75271f689e6f50c7b54c8d"} Jun 10 01:02:27.882729 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.882710 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:02:27.883022 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.882999 2554 generic.go:356] "Generic (PLEG): container finished" podID="243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa" containerID="de3396f88bf2e607b8600423a72cddd663235011daec8b4da0ab8eb99e93167b" exitCode=1 Jun 10 01:02:27.883117 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.883070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"9b3c52b15dce4ad216a07f2d59970e4368456ecb9f4f446abb496f6952ade8f9"} Jun 10 01:02:27.883191 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.883161 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"b327f17c37bb6e0097a2874196402152b2015ea13acd9242821e3426950954c7"} Jun 10 01:02:27.883230 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.883202 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerDied","Data":"de3396f88bf2e607b8600423a72cddd663235011daec8b4da0ab8eb99e93167b"} Jun 10 01:02:27.883271 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.883233 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"584dd6a555deb2b50471983081525945c83c14eb75de3116b283707f6b1549b9"} Jun 10 01:02:27.884397 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.884376 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-tkxfw" event={"ID":"f3e75149-d033-4820-9b04-8d9f9c3a2614","Type":"ContainerStarted","Data":"7e8a46b702112556a9ea2ebd6e322b21d201815f2c344980fc1e2a67fb19123f"} Jun 10 01:02:27.901390 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.901347 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tjsmv" podStartSLOduration=3.972091237 podStartE2EDuration="22.901334663s" totalImagesPullingTime="18.929243426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:27.900378507 +0000 UTC m=+22.625980824" watchObservedRunningTime="2026-06-10 01:02:27.901334663 +0000 UTC m=+22.626936980" Jun 10 01:02:27.901675 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:27.901656 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-1.ec2.internal" podStartSLOduration=21.901650141 podStartE2EDuration="21.901650141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:08.837306612 +0000 UTC m=+3.562908942" watchObservedRunningTime="2026-06-10 01:02:27.901650141 +0000 UTC m=+22.627252490" Jun 10 01:02:28.889001 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.888971 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:02:28.889459 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.889363 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"fcea75cd3b2324628d952e8c91b85d79e7b1ff871cc295f6ba6399baa19093a6"} Jun 10 01:02:28.889500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.889483 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"4a3e8b31b236292998324fd7ff4ce130da0b43b6240c71933b6a44ce30f57f22"} Jun 10 01:02:28.890665 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.890641 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wmdwx" event={"ID":"afb9cf85-3d40-405a-992d-67533fcd33b5","Type":"ContainerStarted","Data":"02bbae6f09e71a8ecbbb2643b6e0fd74925173e4fb0c04ebf8abb9d685045545"} Jun 10 01:02:28.891998 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.891976 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" event={"ID":"c4955bc9-a85f-470b-8144-146354d0854b","Type":"ContainerStarted","Data":"4706786d77880e3241234f9e04bfa480ca21339a0459a91c01f944d47c06e2e5"} Jun 10 01:02:28.893175 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.893158 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xxzpx" event={"ID":"921cf87a-a947-4670-94a0-af969c870dce","Type":"ContainerStarted","Data":"02d0bef19b7480a5a7998972752f985c5ae026d97fea7d70097029f3cc02a9fa"} Jun 10 01:02:28.894536 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.894515 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2tpq7" event={"ID":"47ff70a7-107b-4b1d-a602-11b1b3dd6050","Type":"ContainerStarted","Data":"44e0cd74da32c401f4d90ec5a4473f0750f1ccca6e61b1c9b0e0505cfd8f565d"} Jun 10 01:02:28.895696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.895674 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2ps6g" event={"ID":"7b0f4ee2-8241-47aa-9e9f-e47769fa3cee","Type":"ContainerStarted","Data":"ff19a5d5c85649879ad7877f3db762613b360efca310ce36faab66f28e8a0e0c"} Jun 10 01:02:28.896946 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.896927 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c8040b5-a04e-4bc9-95aa-c5e64c5425b4" containerID="c86bbb5eef37bb7749151983e2899c9c2a04c119c9a6e5685048cc22b0eb88a5" exitCode=0 Jun 10 01:02:28.897038 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.896983 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerDied","Data":"c86bbb5eef37bb7749151983e2899c9c2a04c119c9a6e5685048cc22b0eb88a5"} Jun 10 01:02:28.898357 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.898339 2554 generic.go:356] "Generic (PLEG): container finished" podID="21cae4f3fc4c083932a454cb018ce02d" containerID="eb6b506307188e9dba4aed66b32d5b4ac27ddc9e8e1ee8663c780525f7b26ea6" exitCode=0 Jun 10 01:02:28.898415 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.898400 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" event={"ID":"21cae4f3fc4c083932a454cb018ce02d","Type":"ContainerDied","Data":"eb6b506307188e9dba4aed66b32d5b4ac27ddc9e8e1ee8663c780525f7b26ea6"} Jun 10 01:02:28.904533 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.904499 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-tkxfw" podStartSLOduration=4.915103597 podStartE2EDuration="23.904487984s" totalImagesPullingTime="18.989384387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:27.915803041 +0000 UTC m=+22.641405370" watchObservedRunningTime="2026-06-10 01:02:28.904487984 +0000 UTC m=+23.630090300" Jun 10 01:02:28.904662 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.904645 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wmdwx" podStartSLOduration=4.980990761 podStartE2EDuration="23.90464188s" totalImagesPullingTime="18.923651119s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:28.904235909 +0000 UTC m=+23.629838227" watchObservedRunningTime="2026-06-10 01:02:28.90464188 +0000 UTC m=+23.630244237" Jun 10 01:02:28.928791 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.928743 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xxzpx" podStartSLOduration=13.02170472 podStartE2EDuration="23.928727789s" totalImagesPullingTime="10.907023069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:28.928453964 +0000 UTC m=+23.654056281" watchObservedRunningTime="2026-06-10 01:02:28.928727789 +0000 UTC m=+23.654330105" Jun 10 01:02:28.941758 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.941715 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2tpq7" podStartSLOduration=5.010279058 podStartE2EDuration="23.941698899s" totalImagesPullingTime="18.931419841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:28.9411213 +0000 UTC m=+23.666723613" watchObservedRunningTime="2026-06-10 01:02:28.941698899 +0000 UTC m=+23.667301216" Jun 10 01:02:28.977966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:28.977914 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-2ps6g" podStartSLOduration=4.045595176 podStartE2EDuration="22.977898275s" totalImagesPullingTime="18.932303099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:28.977240742 +0000 UTC m=+23.702843079" watchObservedRunningTime="2026-06-10 01:02:28.977898275 +0000 UTC m=+23.703500592" Jun 10 01:02:29.097554 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.097362 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:29.097888 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.097871 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:29.298374 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.298350 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 01:02:29.811298 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.811259 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:29.811584 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:29.811404 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:29.811584 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.811431 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:29.811584 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:29.811536 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:29.811756 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.811600 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:29.811756 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:29.811700 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:29.814820 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.814722 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T01:02:29.298368628Z","UUID":"1a66da92-40d3-4f2d-b039-c321edc62cba","Handler":null,"Name":"","Endpoint":""} Jun 10 01:02:29.816576 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.816521 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 01:02:29.816576 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.816560 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 01:02:29.903615 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.903569 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" event={"ID":"c4955bc9-a85f-470b-8144-146354d0854b","Type":"ContainerStarted","Data":"3680018551f3146b6ba0fa4e4bac50c88d01265905692271d5feb252669e7d69"} Jun 10 01:02:29.905795 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.905766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" event={"ID":"21cae4f3fc4c083932a454cb018ce02d","Type":"ContainerStarted","Data":"3199342ba5016ed7877752929ecd60859e034813f17b93a9f65dd56fb8a8c557"} Jun 10 01:02:29.906240 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.906213 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:29.906651 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.906630 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xxzpx" Jun 10 01:02:29.919542 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:29.919487 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-1.ec2.internal" podStartSLOduration=23.919469113 podStartE2EDuration="23.919469113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:29.919319051 +0000 UTC m=+24.644921389" watchObservedRunningTime="2026-06-10 01:02:29.919469113 +0000 UTC m=+24.645071431" Jun 10 01:02:30.910923 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:30.910870 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" event={"ID":"c4955bc9-a85f-470b-8144-146354d0854b","Type":"ContainerStarted","Data":"5b51a4663984d8fb0522d9f983dc49c6467d5ba6075b8699209344397c34b6de"} Jun 10 01:02:30.914347 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:30.914320 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:02:30.914745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:30.914718 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"3a603d92c4dc1d386e198fd97d5efeb4d0b40aa1ef250a090dd3a99fc025be5e"} Jun 10 01:02:30.926830 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:30.926784 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-825f4" podStartSLOduration=4.553946253 podStartE2EDuration="25.926764963s" totalImagesPullingTime="21.37281871s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:30.926598933 +0000 UTC m=+25.652201281" watchObservedRunningTime="2026-06-10 01:02:30.926764963 +0000 UTC m=+25.652367278" Jun 10 01:02:31.811425 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:31.811393 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:31.811610 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:31.811540 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:31.811931 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:31.811905 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:31.812058 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:31.812007 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:31.812144 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:31.812067 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:31.812193 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:31.812151 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:33.811744 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.811702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:33.812373 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:33.811806 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:33.812373 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.811702 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:33.812373 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.811847 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:33.812373 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:33.811939 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:33.812373 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:33.812027 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:33.924175 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.924149 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:02:33.924478 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.924458 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"3bf29cdcaddea942029bf1dabdd557ec2e9e823d0c81670897466f7c02e4d234"} Jun 10 01:02:33.924710 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.924684 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:33.924902 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.924882 2554 scope.go:117] "RemoveContainer" containerID="de3396f88bf2e607b8600423a72cddd663235011daec8b4da0ab8eb99e93167b" Jun 10 01:02:33.926375 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.926355 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c8040b5-a04e-4bc9-95aa-c5e64c5425b4" containerID="4c45df66f03913ac226af20db9caa672a977300e5d495083295fb6cb0a8025f7" exitCode=0 Jun 10 01:02:33.926469 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.926386 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerDied","Data":"4c45df66f03913ac226af20db9caa672a977300e5d495083295fb6cb0a8025f7"} Jun 10 01:02:33.942559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:33.942534 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:34.934323 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:34.934294 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:02:34.934862 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:34.934656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" event={"ID":"243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa","Type":"ContainerStarted","Data":"a6e5f61d1308b2737eb3fef499197745e1c4a482f2ab2d53a837b54a024f4ad1"} Jun 10 01:02:34.934941 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:34.934870 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:34.934998 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:34.934951 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:34.950182 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:34.950155 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:02:34.965417 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:34.965368 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" podStartSLOduration=9.971787827 podStartE2EDuration="28.965354119s" totalImagesPullingTime="18.993566292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:34.964025675 +0000 UTC m=+29.689628008" watchObservedRunningTime="2026-06-10 01:02:34.965354119 +0000 UTC m=+29.690956436" Jun 10 01:02:35.252516 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.252341 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9n2dh"] Jun 10 01:02:35.252664 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.252597 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:35.252714 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:35.252680 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:35.255963 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.255914 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbrdw"] Jun 10 01:02:35.256131 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.256042 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:35.256200 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:35.256169 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:35.256637 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.256592 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5scqc"] Jun 10 01:02:35.256768 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.256680 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:35.256839 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:35.256767 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:35.938934 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.938904 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c8040b5-a04e-4bc9-95aa-c5e64c5425b4" containerID="d734a638110debf2de6f6e7314c75fb3341a3106ab91af00fd6a8800dd8e9d52" exitCode=0 Jun 10 01:02:35.939502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:35.938990 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerDied","Data":"d734a638110debf2de6f6e7314c75fb3341a3106ab91af00fd6a8800dd8e9d52"} Jun 10 01:02:36.811750 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:36.811719 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:36.811893 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:36.811786 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:36.811933 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:36.811888 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:36.811933 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:36.811905 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:36.812000 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:36.811980 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:36.812086 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:36.812055 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:37.945329 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:37.945298 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c8040b5-a04e-4bc9-95aa-c5e64c5425b4" containerID="3e9b5902d83099ced4c191c3068ad5255f10085488db98c89f96455da0f0179c" exitCode=0 Jun 10 01:02:37.945860 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:37.945361 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerDied","Data":"3e9b5902d83099ced4c191c3068ad5255f10085488db98c89f96455da0f0179c"} Jun 10 01:02:38.811405 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:38.811315 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:38.811405 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:38.811353 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:38.811405 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:38.811361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:38.811725 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:38.811462 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:02:38.811725 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:38.811602 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5scqc" podUID="5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c" Jun 10 01:02:38.811856 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:38.811737 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9n2dh" podUID="61690ee4-93d0-424d-b3aa-92962ffcebb6" Jun 10 01:02:39.499157 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:39.496895 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:39.499157 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:39.496965 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:39.499157 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.497139 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:39.499157 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.497212 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:11.497184948 +0000 UTC m=+66.222787243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 01:02:39.499157 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.497782 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:39.499157 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.497862 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret podName:61690ee4-93d0-424d-b3aa-92962ffcebb6 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:11.497836697 +0000 UTC m=+66.223438994 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret") pod "global-pull-secret-syncer-9n2dh" (UID: "61690ee4-93d0-424d-b3aa-92962ffcebb6") : object "kube-system"/"original-pull-secret" not registered Jun 10 01:02:39.597492 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:39.597442 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:39.597683 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.597664 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 01:02:39.597740 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.597695 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 01:02:39.597740 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.597710 2554 projected.go:196] Error preparing data for projected volume kube-api-access-mxsdl for pod openshift-network-diagnostics/network-check-target-5scqc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:39.597810 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:39.597789 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl podName:5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c nodeName:}" failed. No retries permitted until 2026-06-10 01:03:11.597770049 +0000 UTC m=+66.323372346 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mxsdl" (UniqueName: "kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl") pod "network-check-target-5scqc" (UID: "5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 01:02:40.135498 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.135465 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-1.ec2.internal" event="NodeReady" Jun 10 01:02:40.135660 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.135620 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 01:02:40.175559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.175525 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b6j5k"] Jun 10 01:02:40.177504 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.177473 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.179143 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.179116 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6g2wj"] Jun 10 01:02:40.179725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.179704 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 01:02:40.179855 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.179790 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 01:02:40.179855 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.179832 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2m2\"" Jun 10 01:02:40.180772 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.180753 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.182754 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.182734 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 01:02:40.182852 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.182792 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 01:02:40.182852 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.182825 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 01:02:40.182852 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.182825 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9gnps\"" Jun 10 01:02:40.190882 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.190829 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6j5k"] Jun 10 01:02:40.194713 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.194679 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6g2wj"] Jun 10 01:02:40.302255 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.302046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.302433 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.302290 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5p9d\" (UniqueName: \"kubernetes.io/projected/aef9794f-16e4-49f4-9942-992cdf29dcb5-kube-api-access-n5p9d\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.302433 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.302314 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aef9794f-16e4-49f4-9942-992cdf29dcb5-tmp-dir\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.302433 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.302414 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e1ba28c-a48d-471b-877f-289a45e7e43c-cert\") pod \"ingress-canary-6g2wj\" (UID: \"6e1ba28c-a48d-471b-877f-289a45e7e43c\") " pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.302572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.302440 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz9m5\" (UniqueName: \"kubernetes.io/projected/6e1ba28c-a48d-471b-877f-289a45e7e43c-kube-api-access-cz9m5\") pod \"ingress-canary-6g2wj\" (UID: \"6e1ba28c-a48d-471b-877f-289a45e7e43c\") " pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.302572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.302505 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aef9794f-16e4-49f4-9942-992cdf29dcb5-config-volume\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.403428 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403395 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aef9794f-16e4-49f4-9942-992cdf29dcb5-config-volume\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.403614 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.403614 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5p9d\" (UniqueName: \"kubernetes.io/projected/aef9794f-16e4-49f4-9942-992cdf29dcb5-kube-api-access-n5p9d\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.403614 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403512 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aef9794f-16e4-49f4-9942-992cdf29dcb5-tmp-dir\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.403614 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403557 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e1ba28c-a48d-471b-877f-289a45e7e43c-cert\") pod \"ingress-canary-6g2wj\" (UID: \"6e1ba28c-a48d-471b-877f-289a45e7e43c\") " pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.403614 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz9m5\" (UniqueName: \"kubernetes.io/projected/6e1ba28c-a48d-471b-877f-289a45e7e43c-kube-api-access-cz9m5\") pod \"ingress-canary-6g2wj\" (UID: \"6e1ba28c-a48d-471b-877f-289a45e7e43c\") " pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.403614 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:40.403593 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:40.403927 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:40.403720 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:40.903699228 +0000 UTC m=+35.629301527 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:02:40.403927 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.403847 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aef9794f-16e4-49f4-9942-992cdf29dcb5-tmp-dir\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.404162 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.404130 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/aef9794f-16e4-49f4-9942-992cdf29dcb5-config-volume\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.408596 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.408570 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6e1ba28c-a48d-471b-877f-289a45e7e43c-cert\") pod \"ingress-canary-6g2wj\" (UID: \"6e1ba28c-a48d-471b-877f-289a45e7e43c\") " pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.411520 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.411500 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5p9d\" (UniqueName: \"kubernetes.io/projected/aef9794f-16e4-49f4-9942-992cdf29dcb5-kube-api-access-n5p9d\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.411802 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.411777 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz9m5\" (UniqueName: \"kubernetes.io/projected/6e1ba28c-a48d-471b-877f-289a45e7e43c-kube-api-access-cz9m5\") pod \"ingress-canary-6g2wj\" (UID: \"6e1ba28c-a48d-471b-877f-289a45e7e43c\") " pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.497930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.497824 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6g2wj" Jun 10 01:02:40.642188 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.642156 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6g2wj"] Jun 10 01:02:40.646790 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:40.646758 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e1ba28c_a48d_471b_877f_289a45e7e43c.slice/crio-e1b67855889937b6397913b1ca43872a7bc1cf8ae111a320b13a666381945f43 WatchSource:0}: Error finding container e1b67855889937b6397913b1ca43872a7bc1cf8ae111a320b13a666381945f43: Status 404 returned error can't find the container with id e1b67855889937b6397913b1ca43872a7bc1cf8ae111a320b13a666381945f43 Jun 10 01:02:40.811502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.811412 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:02:40.811502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.811472 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:02:40.811729 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.811412 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:02:40.813609 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.813587 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:02:40.813745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.813723 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ll2dx\"" Jun 10 01:02:40.813816 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.813759 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mkts\"" Jun 10 01:02:40.813816 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.813811 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:02:40.814006 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.813987 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:02:40.814457 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.814440 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:02:40.908300 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.908257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:40.908494 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:40.908377 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:40.908494 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:40.908457 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:41.908438673 +0000 UTC m=+36.634040968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:02:40.956339 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:40.956300 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6g2wj" event={"ID":"6e1ba28c-a48d-471b-877f-289a45e7e43c","Type":"ContainerStarted","Data":"e1b67855889937b6397913b1ca43872a7bc1cf8ae111a320b13a666381945f43"} Jun 10 01:02:41.915451 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:41.915406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:41.915928 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:41.915559 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:41.915928 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:41.915634 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:43.915612265 +0000 UTC m=+38.641214561 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:02:42.964910 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:42.964653 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c8040b5-a04e-4bc9-95aa-c5e64c5425b4" containerID="31407a137d0e15b52204e862f40524840bfea3caeff198ade8cb8afd6fb579ff" exitCode=0 Jun 10 01:02:42.964910 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:42.964730 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerDied","Data":"31407a137d0e15b52204e862f40524840bfea3caeff198ade8cb8afd6fb579ff"} Jun 10 01:02:43.931359 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:43.931330 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:43.931575 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:43.931445 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:43.931575 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:43.931497 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:47.931484539 +0000 UTC m=+42.657086835 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:02:43.969962 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:43.969932 2554 generic.go:356] "Generic (PLEG): container finished" podID="7c8040b5-a04e-4bc9-95aa-c5e64c5425b4" containerID="767e38eb44350f3ec4e1e3b00d6b1101fae78e4af649628f590f1ad9cf821fa8" exitCode=0 Jun 10 01:02:43.970354 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:43.970004 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerDied","Data":"767e38eb44350f3ec4e1e3b00d6b1101fae78e4af649628f590f1ad9cf821fa8"} Jun 10 01:02:44.975809 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:44.975721 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rmln5" event={"ID":"7c8040b5-a04e-4bc9-95aa-c5e64c5425b4","Type":"ContainerStarted","Data":"a85846b6c869bef3592bf9f829573b139eb966f737e1aba37093ac0bad22461c"} Jun 10 01:02:44.977161 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:44.977137 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6g2wj" event={"ID":"6e1ba28c-a48d-471b-877f-289a45e7e43c","Type":"ContainerStarted","Data":"2326d57302a15e3b2ea70ad790f376cea3b5c7f9e247985115d19e3c64ebec1d"} Jun 10 01:02:44.996220 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:44.996177 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rmln5" podStartSLOduration=10.308394472 podStartE2EDuration="39.996163138s" totalImagesPullingTime="29.687768666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:44.994918875 +0000 UTC m=+39.720521203" watchObservedRunningTime="2026-06-10 01:02:44.996163138 +0000 UTC m=+39.721765455" Jun 10 01:02:45.009025 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:45.008979 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6g2wj" podStartSLOduration=1.715691222 podStartE2EDuration="5.008963703s" totalImagesPullingTime="3.293272481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:45.008204967 +0000 UTC m=+39.733807320" watchObservedRunningTime="2026-06-10 01:02:45.008963703 +0000 UTC m=+39.734566020" Jun 10 01:02:46.761037 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.761000 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7"] Jun 10 01:02:46.788331 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.788298 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7"] Jun 10 01:02:46.788470 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.788343 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:46.791305 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.791281 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vcpb6\"" Jun 10 01:02:46.791305 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.791291 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 10 01:02:46.791482 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.791311 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 10 01:02:46.791482 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.791323 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 10 01:02:46.791600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.791576 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 10 01:02:46.952609 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.952563 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81f3552d-825f-4024-90e7-b5e714be4f8b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658778f598-8m8s7\" (UID: \"81f3552d-825f-4024-90e7-b5e714be4f8b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:46.952609 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:46.952612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h4mn\" (UniqueName: \"kubernetes.io/projected/81f3552d-825f-4024-90e7-b5e714be4f8b-kube-api-access-2h4mn\") pod \"managed-serviceaccount-addon-agent-658778f598-8m8s7\" (UID: \"81f3552d-825f-4024-90e7-b5e714be4f8b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:47.053668 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.053582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81f3552d-825f-4024-90e7-b5e714be4f8b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658778f598-8m8s7\" (UID: \"81f3552d-825f-4024-90e7-b5e714be4f8b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:47.053668 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.053615 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h4mn\" (UniqueName: \"kubernetes.io/projected/81f3552d-825f-4024-90e7-b5e714be4f8b-kube-api-access-2h4mn\") pod \"managed-serviceaccount-addon-agent-658778f598-8m8s7\" (UID: \"81f3552d-825f-4024-90e7-b5e714be4f8b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:47.059788 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.059760 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/81f3552d-825f-4024-90e7-b5e714be4f8b-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-658778f598-8m8s7\" (UID: \"81f3552d-825f-4024-90e7-b5e714be4f8b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:47.060558 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.060535 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h4mn\" (UniqueName: \"kubernetes.io/projected/81f3552d-825f-4024-90e7-b5e714be4f8b-kube-api-access-2h4mn\") pod \"managed-serviceaccount-addon-agent-658778f598-8m8s7\" (UID: \"81f3552d-825f-4024-90e7-b5e714be4f8b\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:47.108734 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.108686 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:02:47.241289 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.241258 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7"] Jun 10 01:02:47.244446 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:02:47.244413 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81f3552d_825f_4024_90e7_b5e714be4f8b.slice/crio-8362c2cf603393c979df32df5d500d91ed9d6f153107084fbbd89ab87e4c8613 WatchSource:0}: Error finding container 8362c2cf603393c979df32df5d500d91ed9d6f153107084fbbd89ab87e4c8613: Status 404 returned error can't find the container with id 8362c2cf603393c979df32df5d500d91ed9d6f153107084fbbd89ab87e4c8613 Jun 10 01:02:47.958795 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.958763 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:47.959197 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:47.958910 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:47.959197 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:47.958977 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:02:55.95895905 +0000 UTC m=+50.684561346 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:02:47.985271 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:47.985232 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" event={"ID":"81f3552d-825f-4024-90e7-b5e714be4f8b","Type":"ContainerStarted","Data":"8362c2cf603393c979df32df5d500d91ed9d6f153107084fbbd89ab87e4c8613"} Jun 10 01:02:50.994055 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:50.994024 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" event={"ID":"81f3552d-825f-4024-90e7-b5e714be4f8b","Type":"ContainerStarted","Data":"500df660c7647612bf9db4ac1d75a4937a5b2c2f98d357a7b975b1c50cac3d3d"} Jun 10 01:02:51.008498 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:51.008448 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" podStartSLOduration=1.638122189 podStartE2EDuration="5.00843223s" totalImagesPullingTime="3.370310041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:02:51.007857498 +0000 UTC m=+45.733459827" watchObservedRunningTime="2026-06-10 01:02:51.00843223 +0000 UTC m=+45.734034546" Jun 10 01:02:56.013351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:02:56.013311 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:02:56.013893 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:56.013454 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:02:56.013893 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:02:56.013509 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:12.0134948 +0000 UTC m=+66.739097095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:03:06.956369 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:06.956343 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsl45" Jun 10 01:03:11.517985 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.517935 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:03:11.518520 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.518052 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:03:11.520889 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.520866 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 01:03:11.520990 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.520969 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 01:03:11.528609 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:03:11.528589 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:03:11.528704 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:03:11.528669 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:15.528647321 +0000 UTC m=+130.254249615 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : secret "metrics-daemon-secret" not found Jun 10 01:03:11.530668 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.530652 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61690ee4-93d0-424d-b3aa-92962ffcebb6-original-pull-secret\") pod \"global-pull-secret-syncer-9n2dh\" (UID: \"61690ee4-93d0-424d-b3aa-92962ffcebb6\") " pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:03:11.619271 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.619222 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:03:11.621749 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.621730 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 01:03:11.631546 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.631527 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 01:03:11.642572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.642545 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxsdl\" (UniqueName: \"kubernetes.io/projected/5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c-kube-api-access-mxsdl\") pod \"network-check-target-5scqc\" (UID: \"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c\") " pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:03:11.732574 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.732544 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8mkts\"" Jun 10 01:03:11.736124 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.736107 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9n2dh" Jun 10 01:03:11.740919 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.740901 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:03:11.868724 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.868685 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9n2dh"] Jun 10 01:03:11.872383 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:03:11.872358 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61690ee4_93d0_424d_b3aa_92962ffcebb6.slice/crio-019d2175887af8dd20e5c5b11783ee165b26b46d1938d45530cb8bfba05feab0 WatchSource:0}: Error finding container 019d2175887af8dd20e5c5b11783ee165b26b46d1938d45530cb8bfba05feab0: Status 404 returned error can't find the container with id 019d2175887af8dd20e5c5b11783ee165b26b46d1938d45530cb8bfba05feab0 Jun 10 01:03:11.883030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:11.883006 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5scqc"] Jun 10 01:03:11.885896 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:03:11.885864 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ce56d0d_2ffa_4e3c_a4b2_12fd2522a48c.slice/crio-b80a53404df99e3963504155cd7c1e08ffa666c12f15d887f69253b6b3f4b056 WatchSource:0}: Error finding container b80a53404df99e3963504155cd7c1e08ffa666c12f15d887f69253b6b3f4b056: Status 404 returned error can't find the container with id b80a53404df99e3963504155cd7c1e08ffa666c12f15d887f69253b6b3f4b056 Jun 10 01:03:12.022561 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:12.022519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:03:12.022728 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:03:12.022661 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:03:12.022728 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:03:12.022722 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:03:44.02270429 +0000 UTC m=+98.748306606 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:03:12.043976 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:12.043875 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9n2dh" event={"ID":"61690ee4-93d0-424d-b3aa-92962ffcebb6","Type":"ContainerStarted","Data":"019d2175887af8dd20e5c5b11783ee165b26b46d1938d45530cb8bfba05feab0"} Jun 10 01:03:12.044971 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:12.044947 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5scqc" event={"ID":"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c","Type":"ContainerStarted","Data":"b80a53404df99e3963504155cd7c1e08ffa666c12f15d887f69253b6b3f4b056"} Jun 10 01:03:17.057985 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:17.057946 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9n2dh" event={"ID":"61690ee4-93d0-424d-b3aa-92962ffcebb6","Type":"ContainerStarted","Data":"2f2ed5b59ee3c5965a5d2d3685815bb6135d10917455b7d1ed5355bcedeaa9f4"} Jun 10 01:03:17.059379 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:17.059357 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5scqc" event={"ID":"5ce56d0d-2ffa-4e3c-a4b2-12fd2522a48c","Type":"ContainerStarted","Data":"17934b125104e531d04ff0f5a1a2b2edc1fe50798e7773f81eeefebd9162e53f"} Jun 10 01:03:17.059495 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:17.059484 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:03:17.071914 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:17.071873 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9n2dh" podStartSLOduration=66.608317357 podStartE2EDuration="1m11.071859032s" totalImagesPullingTime="4.463541675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:17.07141449 +0000 UTC m=+71.797016817" watchObservedRunningTime="2026-06-10 01:03:17.071859032 +0000 UTC m=+71.797461349" Jun 10 01:03:17.087420 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:17.087368 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5scqc" podStartSLOduration=66.639468334 podStartE2EDuration="1m11.087353711s" totalImagesPullingTime="4.447885377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:03:17.087050897 +0000 UTC m=+71.812653215" watchObservedRunningTime="2026-06-10 01:03:17.087353711 +0000 UTC m=+71.812956025" Jun 10 01:03:44.034858 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:44.034737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:03:44.034858 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:03:44.034848 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:03:44.035347 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:03:44.034909 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:04:48.034895049 +0000 UTC m=+162.760497345 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:03:48.064229 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:03:48.064194 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5scqc" Jun 10 01:04:15.544209 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:15.544163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:04:15.544689 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:04:15.544305 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 01:04:15.544689 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:04:15.544375 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs podName:9a7de745-ffdf-4b32-a818-7c023c9a0633 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:17.544360444 +0000 UTC m=+252.269962738 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs") pod "network-metrics-daemon-vbrdw" (UID: "9a7de745-ffdf-4b32-a818-7c023c9a0633") : secret "metrics-daemon-secret" not found Jun 10 01:04:43.190218 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:04:43.190163 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b6j5k" podUID="aef9794f-16e4-49f4-9942-992cdf29dcb5" Jun 10 01:04:43.260716 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:43.260687 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6j5k" Jun 10 01:04:43.823461 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:04:43.823423 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-vbrdw" podUID="9a7de745-ffdf-4b32-a818-7c023c9a0633" Jun 10 01:04:48.072465 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:48.072424 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:04:48.072893 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:04:48.072542 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 01:04:48.072893 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:04:48.072605 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls podName:aef9794f-16e4-49f4-9942-992cdf29dcb5 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:50.072590122 +0000 UTC m=+284.798192418 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls") pod "dns-default-b6j5k" (UID: "aef9794f-16e4-49f4-9942-992cdf29dcb5") : secret "dns-default-metrics-tls" not found Jun 10 01:04:51.280713 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:51.280681 2554 generic.go:356] "Generic (PLEG): container finished" podID="81f3552d-825f-4024-90e7-b5e714be4f8b" containerID="500df660c7647612bf9db4ac1d75a4937a5b2c2f98d357a7b975b1c50cac3d3d" exitCode=255 Jun 10 01:04:51.281178 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:51.280732 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" event={"ID":"81f3552d-825f-4024-90e7-b5e714be4f8b","Type":"ContainerDied","Data":"500df660c7647612bf9db4ac1d75a4937a5b2c2f98d357a7b975b1c50cac3d3d"} Jun 10 01:04:51.286441 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:51.286420 2554 scope.go:117] "RemoveContainer" containerID="500df660c7647612bf9db4ac1d75a4937a5b2c2f98d357a7b975b1c50cac3d3d" Jun 10 01:04:52.285384 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:52.285301 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" event={"ID":"81f3552d-825f-4024-90e7-b5e714be4f8b","Type":"ContainerStarted","Data":"4ad2bd6eee8ab3c42d09cc501e2ca6408e0cde6eacfaa75d64e0e6536bf95740"} Jun 10 01:04:55.813318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:04:55.813282 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:05:49.249971 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.249928 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-67dd4c555c-j4dsf"] Jun 10 01:05:49.251781 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.251765 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5d962"] Jun 10 01:05:49.251896 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.251877 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.253332 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.253311 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" Jun 10 01:05:49.254355 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254335 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jlkpz\"" Jun 10 01:05:49.254445 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254335 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 01:05:49.254445 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254342 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.254556 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254498 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 01:05:49.254794 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254773 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 01:05:49.254893 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254778 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.254893 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.254807 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 01:05:49.255370 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.255354 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-llpf8\"" Jun 10 01:05:49.262919 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.262898 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5d962"] Jun 10 01:05:49.266043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.266021 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67dd4c555c-j4dsf"] Jun 10 01:05:49.335871 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.335839 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mnnbc"] Jun 10 01:05:49.337651 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.337621 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76bd7f87cc-gx85k"] Jun 10 01:05:49.337751 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.337727 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.339818 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.339801 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.342100 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.342061 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 01:05:49.342211 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.342132 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 01:05:49.342211 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.342205 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 01:05:49.342894 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.342872 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:05:49.343305 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.343283 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9fhwg\"" Jun 10 01:05:49.343407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.343286 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 01:05:49.343949 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.343933 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lvz7s\"" Jun 10 01:05:49.344113 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.344093 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 01:05:49.344674 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.344435 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 01:05:49.354955 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.354612 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 01:05:49.356149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.356127 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 01:05:49.356262 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.356153 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mnnbc"] Jun 10 01:05:49.357095 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.357059 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bd7f87cc-gx85k"] Jun 10 01:05:49.394968 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.394938 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-default-certificate\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.394968 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.394973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.394991 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-ca-trust-extracted\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-certificates\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395100 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-trusted-ca\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395140 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-installation-pull-secrets\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395167 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw2k5\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-kube-api-access-gw2k5\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395193 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395221 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06081cb6-3657-4e88-a062-ae05eac02ca0-trusted-ca\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.395248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395245 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-image-registry-private-configuration\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395280 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-bound-sa-token\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06081cb6-3657-4e88-a062-ae05eac02ca0-config\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395383 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395417 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7rpx\" (UniqueName: \"kubernetes.io/projected/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-kube-api-access-p7rpx\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395441 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnnwd\" (UniqueName: \"kubernetes.io/projected/25f8397d-29b9-4e29-8ba3-83a74f6d47fa-kube-api-access-nnnwd\") pod \"network-check-source-dbd9cf844-5d962\" (UID: \"25f8397d-29b9-4e29-8ba3-83a74f6d47fa\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395469 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crn7r\" (UniqueName: \"kubernetes.io/projected/06081cb6-3657-4e88-a062-ae05eac02ca0-kube-api-access-crn7r\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395494 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-stats-auth\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.395631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.395547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06081cb6-3657-4e88-a062-ae05eac02ca0-serving-cert\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.496694 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496649 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496694 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496695 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-ca-trust-extracted\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496722 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-certificates\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-trusted-ca\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496766 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-installation-pull-secrets\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496803 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw2k5\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-kube-api-access-gw2k5\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:49.496806 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:49.496827 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bd7f87cc-gx85k: secret "image-registry-tls" not found Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496857 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06081cb6-3657-4e88-a062-ae05eac02ca0-trusted-ca\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496881 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-image-registry-private-configuration\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-bound-sa-token\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.496966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.496953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06081cb6-3657-4e88-a062-ae05eac02ca0-config\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497002 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7rpx\" (UniqueName: \"kubernetes.io/projected/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-kube-api-access-p7rpx\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnnwd\" (UniqueName: \"kubernetes.io/projected/25f8397d-29b9-4e29-8ba3-83a74f6d47fa-kube-api-access-nnnwd\") pod \"network-check-source-dbd9cf844-5d962\" (UID: \"25f8397d-29b9-4e29-8ba3-83a74f6d47fa\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crn7r\" (UniqueName: \"kubernetes.io/projected/06081cb6-3657-4e88-a062-ae05eac02ca0-kube-api-access-crn7r\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-stats-auth\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497171 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06081cb6-3657-4e88-a062-ae05eac02ca0-serving-cert\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497193 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-ca-trust-extracted\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497247 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-default-certificate\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:49.497471 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497482 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-certificates\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.497630 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:49.497542 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:49.997521145 +0000 UTC m=+224.723123460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : secret "router-metrics-certs-default" not found Jun 10 01:05:49.498237 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.497797 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-trusted-ca\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.498237 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:49.497814 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:49.997794786 +0000 UTC m=+224.723397084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : configmap references non-existent config key: service-ca.crt Jun 10 01:05:49.498237 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:49.498025 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls podName:c9378dab-a295-4d92-92b7-1b5ce5c86c4d nodeName:}" failed. No retries permitted until 2026-06-10 01:05:49.9980056 +0000 UTC m=+224.723607911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls") pod "image-registry-76bd7f87cc-gx85k" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d") : secret "image-registry-tls" not found Jun 10 01:05:49.498237 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.498018 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/06081cb6-3657-4e88-a062-ae05eac02ca0-config\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.498751 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.498721 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06081cb6-3657-4e88-a062-ae05eac02ca0-trusted-ca\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.499677 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.499655 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/06081cb6-3657-4e88-a062-ae05eac02ca0-serving-cert\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.499791 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.499774 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-installation-pull-secrets\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.500065 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.500009 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-default-certificate\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.500181 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.500133 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-stats-auth\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.500275 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.500255 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-image-registry-private-configuration\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.505586 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.505554 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw2k5\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-kube-api-access-gw2k5\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.505692 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.505580 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnnwd\" (UniqueName: \"kubernetes.io/projected/25f8397d-29b9-4e29-8ba3-83a74f6d47fa-kube-api-access-nnnwd\") pod \"network-check-source-dbd9cf844-5d962\" (UID: \"25f8397d-29b9-4e29-8ba3-83a74f6d47fa\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" Jun 10 01:05:49.506494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.506452 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crn7r\" (UniqueName: \"kubernetes.io/projected/06081cb6-3657-4e88-a062-ae05eac02ca0-kube-api-access-crn7r\") pod \"console-operator-668fdbf85c-mnnbc\" (UID: \"06081cb6-3657-4e88-a062-ae05eac02ca0\") " pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.506494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.506500 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7rpx\" (UniqueName: \"kubernetes.io/projected/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-kube-api-access-p7rpx\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:49.506883 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.506863 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-bound-sa-token\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:49.567692 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.567655 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" Jun 10 01:05:49.648456 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.648425 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:49.689019 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.688979 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-5d962"] Jun 10 01:05:49.692091 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:05:49.692053 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f8397d_29b9_4e29_8ba3_83a74f6d47fa.slice/crio-ee1cc13f4d36d56a50109636f372ac5d4fceb38ef2a0af9b72da48f24bb0051d WatchSource:0}: Error finding container ee1cc13f4d36d56a50109636f372ac5d4fceb38ef2a0af9b72da48f24bb0051d: Status 404 returned error can't find the container with id ee1cc13f4d36d56a50109636f372ac5d4fceb38ef2a0af9b72da48f24bb0051d Jun 10 01:05:49.775421 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:49.775392 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-mnnbc"] Jun 10 01:05:49.778214 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:05:49.778184 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06081cb6_3657_4e88_a062_ae05eac02ca0.slice/crio-2340ad1e5faf57969dd533dc9a932d8c2ed939983b2f6184d1134f9a93f01fde WatchSource:0}: Error finding container 2340ad1e5faf57969dd533dc9a932d8c2ed939983b2f6184d1134f9a93f01fde: Status 404 returned error can't find the container with id 2340ad1e5faf57969dd533dc9a932d8c2ed939983b2f6184d1134f9a93f01fde Jun 10 01:05:50.001265 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.001169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:50.001265 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.001220 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:50.001495 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:50.001348 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:05:50.001495 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:50.001371 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bd7f87cc-gx85k: secret "image-registry-tls" not found Jun 10 01:05:50.001495 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:50.001432 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls podName:c9378dab-a295-4d92-92b7-1b5ce5c86c4d nodeName:}" failed. No retries permitted until 2026-06-10 01:05:51.00141205 +0000 UTC m=+225.727014351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls") pod "image-registry-76bd7f87cc-gx85k" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d") : secret "image-registry-tls" not found Jun 10 01:05:50.001495 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.001472 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:50.001689 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:50.001538 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:51.001517543 +0000 UTC m=+225.727119851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : configmap references non-existent config key: service-ca.crt Jun 10 01:05:50.001689 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:50.001567 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:05:50.001689 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:50.001608 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:51.001597122 +0000 UTC m=+225.727199434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : secret "router-metrics-certs-default" not found Jun 10 01:05:50.450484 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.450439 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" event={"ID":"25f8397d-29b9-4e29-8ba3-83a74f6d47fa","Type":"ContainerStarted","Data":"200004f8395348313631ca38a581a8ca5ba821e5313baa0b1aca1cd79d0c1175"} Jun 10 01:05:50.450966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.450505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" event={"ID":"25f8397d-29b9-4e29-8ba3-83a74f6d47fa","Type":"ContainerStarted","Data":"ee1cc13f4d36d56a50109636f372ac5d4fceb38ef2a0af9b72da48f24bb0051d"} Jun 10 01:05:50.451766 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.451735 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" event={"ID":"06081cb6-3657-4e88-a062-ae05eac02ca0","Type":"ContainerStarted","Data":"2340ad1e5faf57969dd533dc9a932d8c2ed939983b2f6184d1134f9a93f01fde"} Jun 10 01:05:50.465468 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:50.465415 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-5d962" podStartSLOduration=1.465400994 podStartE2EDuration="1.465400994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:50.464172457 +0000 UTC m=+225.189774803" watchObservedRunningTime="2026-06-10 01:05:50.465400994 +0000 UTC m=+225.191003310" Jun 10 01:05:51.010716 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:51.010680 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:51.010885 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:51.010725 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:51.010885 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:51.010834 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:53.010819411 +0000 UTC m=+227.736421706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : configmap references non-existent config key: service-ca.crt Jun 10 01:05:51.010885 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:51.010833 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:05:51.010885 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:51.010857 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bd7f87cc-gx85k: secret "image-registry-tls" not found Jun 10 01:05:51.010885 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:51.010865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:51.011049 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:51.010898 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls podName:c9378dab-a295-4d92-92b7-1b5ce5c86c4d nodeName:}" failed. No retries permitted until 2026-06-10 01:05:53.010886221 +0000 UTC m=+227.736488516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls") pod "image-registry-76bd7f87cc-gx85k" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d") : secret "image-registry-tls" not found Jun 10 01:05:51.011049 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:51.010940 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:05:51.011049 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:51.010964 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:53.0109571 +0000 UTC m=+227.736559395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : secret "router-metrics-certs-default" not found Jun 10 01:05:53.028192 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.028069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:53.028192 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.028130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:53.028232 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:57.028217981 +0000 UTC m=+231.753820275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : configmap references non-existent config key: service-ca.crt Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:53.028240 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:53.028267 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bd7f87cc-gx85k: secret "image-registry-tls" not found Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.028315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:53.028368 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:53.028378 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls podName:c9378dab-a295-4d92-92b7-1b5ce5c86c4d nodeName:}" failed. No retries permitted until 2026-06-10 01:05:57.028366196 +0000 UTC m=+231.753968490 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls") pod "image-registry-76bd7f87cc-gx85k" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d") : secret "image-registry-tls" not found Jun 10 01:05:53.028633 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:53.028408 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:05:57.028393027 +0000 UTC m=+231.753995328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : secret "router-metrics-certs-default" not found Jun 10 01:05:53.463218 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.463186 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/0.log" Jun 10 01:05:53.463400 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.463229 2554 generic.go:356] "Generic (PLEG): container finished" podID="06081cb6-3657-4e88-a062-ae05eac02ca0" containerID="190e805155ba31e9b907a57f7a62aa0494af477af24a2592f37d8d99039bf294" exitCode=255 Jun 10 01:05:53.463400 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.463298 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" event={"ID":"06081cb6-3657-4e88-a062-ae05eac02ca0","Type":"ContainerDied","Data":"190e805155ba31e9b907a57f7a62aa0494af477af24a2592f37d8d99039bf294"} Jun 10 01:05:53.463574 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:53.463560 2554 scope.go:117] "RemoveContainer" containerID="190e805155ba31e9b907a57f7a62aa0494af477af24a2592f37d8d99039bf294" Jun 10 01:05:54.315398 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.315364 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb"] Jun 10 01:05:54.317537 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.317521 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" Jun 10 01:05:54.319948 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.319914 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 01:05:54.319948 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.319936 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 01:05:54.320152 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.319939 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-r8t27\"" Jun 10 01:05:54.328574 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.328545 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb"] Jun 10 01:05:54.439268 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.439229 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68fpq\" (UniqueName: \"kubernetes.io/projected/d9bfaf8d-450d-4839-9db2-3c09ea7f36db-kube-api-access-68fpq\") pod \"migrator-955ffdf5f-2s4jb\" (UID: \"d9bfaf8d-450d-4839-9db2-3c09ea7f36db\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" Jun 10 01:05:54.467859 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.467831 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/1.log" Jun 10 01:05:54.468293 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.468274 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/0.log" Jun 10 01:05:54.468401 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.468315 2554 generic.go:356] "Generic (PLEG): container finished" podID="06081cb6-3657-4e88-a062-ae05eac02ca0" containerID="963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9" exitCode=255 Jun 10 01:05:54.468401 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.468349 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" event={"ID":"06081cb6-3657-4e88-a062-ae05eac02ca0","Type":"ContainerDied","Data":"963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9"} Jun 10 01:05:54.468504 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.468427 2554 scope.go:117] "RemoveContainer" containerID="190e805155ba31e9b907a57f7a62aa0494af477af24a2592f37d8d99039bf294" Jun 10 01:05:54.468624 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.468609 2554 scope.go:117] "RemoveContainer" containerID="963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9" Jun 10 01:05:54.468810 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:54.468776 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbc_openshift-console-operator(06081cb6-3657-4e88-a062-ae05eac02ca0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podUID="06081cb6-3657-4e88-a062-ae05eac02ca0" Jun 10 01:05:54.540606 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.540562 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68fpq\" (UniqueName: \"kubernetes.io/projected/d9bfaf8d-450d-4839-9db2-3c09ea7f36db-kube-api-access-68fpq\") pod \"migrator-955ffdf5f-2s4jb\" (UID: \"d9bfaf8d-450d-4839-9db2-3c09ea7f36db\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" Jun 10 01:05:54.548120 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.548091 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68fpq\" (UniqueName: \"kubernetes.io/projected/d9bfaf8d-450d-4839-9db2-3c09ea7f36db-kube-api-access-68fpq\") pod \"migrator-955ffdf5f-2s4jb\" (UID: \"d9bfaf8d-450d-4839-9db2-3c09ea7f36db\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" Jun 10 01:05:54.625474 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.625382 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" Jun 10 01:05:54.745527 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:54.745500 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb"] Jun 10 01:05:54.748000 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:05:54.747971 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9bfaf8d_450d_4839_9db2_3c09ea7f36db.slice/crio-bb29fca238fe0f1292165ee3dcff2d4286b1eeb4db075dba29d125334631ef5b WatchSource:0}: Error finding container bb29fca238fe0f1292165ee3dcff2d4286b1eeb4db075dba29d125334631ef5b: Status 404 returned error can't find the container with id bb29fca238fe0f1292165ee3dcff2d4286b1eeb4db075dba29d125334631ef5b Jun 10 01:05:55.472708 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:55.472667 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" event={"ID":"d9bfaf8d-450d-4839-9db2-3c09ea7f36db","Type":"ContainerStarted","Data":"bb29fca238fe0f1292165ee3dcff2d4286b1eeb4db075dba29d125334631ef5b"} Jun 10 01:05:55.474293 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:55.474272 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/1.log" Jun 10 01:05:55.474629 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:55.474613 2554 scope.go:117] "RemoveContainer" containerID="963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9" Jun 10 01:05:55.474812 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:55.474791 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbc_openshift-console-operator(06081cb6-3657-4e88-a062-ae05eac02ca0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podUID="06081cb6-3657-4e88-a062-ae05eac02ca0" Jun 10 01:05:55.803950 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:55.803866 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2ps6g_7b0f4ee2-8241-47aa-9e9f-e47769fa3cee/dns-node-resolver/0.log" Jun 10 01:05:56.478594 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:56.478556 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" event={"ID":"d9bfaf8d-450d-4839-9db2-3c09ea7f36db","Type":"ContainerStarted","Data":"b9a6ddf748510a0d048cb1fde2fc542574ba98a6541962c3d53ea80a539784e3"} Jun 10 01:05:56.478995 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:56.478639 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" event={"ID":"d9bfaf8d-450d-4839-9db2-3c09ea7f36db","Type":"ContainerStarted","Data":"354d8b0fd25b4736218f2e61d28e2798b6fc1cf935a7fc8c54fcb4a7c814cb28"} Jun 10 01:05:56.493642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:56.493583 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-2s4jb" podStartSLOduration=1.369328856 podStartE2EDuration="2.493566363s" totalImagesPullingTime="1.124237507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:05:56.492515001 +0000 UTC m=+231.218117317" watchObservedRunningTime="2026-06-10 01:05:56.493566363 +0000 UTC m=+231.219168679" Jun 10 01:05:56.804460 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:56.804389 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2tpq7_47ff70a7-107b-4b1d-a602-11b1b3dd6050/node-ca/0.log" Jun 10 01:05:57.060566 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:57.060471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:57.060566 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:57.060518 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:05:57.060566 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:57.060539 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:05:57.060834 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:57.060636 2554 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 01:05:57.060834 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:57.060667 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:05.060652538 +0000 UTC m=+239.786254832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : configmap references non-existent config key: service-ca.crt Jun 10 01:05:57.060834 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:57.060708 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs podName:deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:05.060692131 +0000 UTC m=+239.786294433 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs") pod "router-default-67dd4c555c-j4dsf" (UID: "deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3") : secret "router-metrics-certs-default" not found Jun 10 01:05:57.060834 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:57.060636 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 01:05:57.060834 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:57.060728 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76bd7f87cc-gx85k: secret "image-registry-tls" not found Jun 10 01:05:57.060834 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:57.060773 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls podName:c9378dab-a295-4d92-92b7-1b5ce5c86c4d nodeName:}" failed. No retries permitted until 2026-06-10 01:06:05.06076159 +0000 UTC m=+239.786363885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls") pod "image-registry-76bd7f87cc-gx85k" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d") : secret "image-registry-tls" not found Jun 10 01:05:57.604062 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:57.604029 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6g2wj_6e1ba28c-a48d-471b-877f-289a45e7e43c/serve-healthcheck-canary/0.log" Jun 10 01:05:59.649476 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:59.649441 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:59.649850 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:59.649502 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:05:59.649850 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:05:59.649814 2554 scope.go:117] "RemoveContainer" containerID="963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9" Jun 10 01:05:59.650008 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:05:59.649988 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbc_openshift-console-operator(06081cb6-3657-4e88-a062-ae05eac02ca0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podUID="06081cb6-3657-4e88-a062-ae05eac02ca0" Jun 10 01:06:05.124229 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.124187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:05.124229 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.124233 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:06:05.124704 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.124368 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:05.124975 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.124952 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-service-ca-bundle\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:05.126680 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.126654 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"image-registry-76bd7f87cc-gx85k\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:06:05.126782 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.126659 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3-metrics-certs\") pod \"router-default-67dd4c555c-j4dsf\" (UID: \"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3\") " pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:05.162784 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.162740 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:05.256539 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.256482 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:06:05.293478 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.293445 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-67dd4c555c-j4dsf"] Jun 10 01:06:05.297349 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:05.297319 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeacd08b_8eb1_42ec_aa1f_d07a9ecab4c3.slice/crio-e2a94562e4f8094a6b0f17810619b53bb87f34cf3cfed7844431d8f2b6c50253 WatchSource:0}: Error finding container e2a94562e4f8094a6b0f17810619b53bb87f34cf3cfed7844431d8f2b6c50253: Status 404 returned error can't find the container with id e2a94562e4f8094a6b0f17810619b53bb87f34cf3cfed7844431d8f2b6c50253 Jun 10 01:06:05.393767 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.393737 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76bd7f87cc-gx85k"] Jun 10 01:06:05.396472 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:05.396439 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9378dab_a295_4d92_92b7_1b5ce5c86c4d.slice/crio-95bc7434c9227fe27358e33d06bc293c84567f181c3a5ac25de1c36465a76acd WatchSource:0}: Error finding container 95bc7434c9227fe27358e33d06bc293c84567f181c3a5ac25de1c36465a76acd: Status 404 returned error can't find the container with id 95bc7434c9227fe27358e33d06bc293c84567f181c3a5ac25de1c36465a76acd Jun 10 01:06:05.509746 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.509706 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" event={"ID":"c9378dab-a295-4d92-92b7-1b5ce5c86c4d","Type":"ContainerStarted","Data":"505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3"} Jun 10 01:06:05.509942 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.509771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" event={"ID":"c9378dab-a295-4d92-92b7-1b5ce5c86c4d","Type":"ContainerStarted","Data":"95bc7434c9227fe27358e33d06bc293c84567f181c3a5ac25de1c36465a76acd"} Jun 10 01:06:05.509942 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.509820 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:06:05.511802 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.511766 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" event={"ID":"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3","Type":"ContainerStarted","Data":"553b7f327e2eecd3e60b98afe600e53c23154e96204daea793adc663bc85f02e"} Jun 10 01:06:05.511954 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.511816 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" event={"ID":"deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3","Type":"ContainerStarted","Data":"e2a94562e4f8094a6b0f17810619b53bb87f34cf3cfed7844431d8f2b6c50253"} Jun 10 01:06:05.526491 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.526395 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" podStartSLOduration=16.52637258 podStartE2EDuration="16.52637258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:05.525985182 +0000 UTC m=+240.251587527" watchObservedRunningTime="2026-06-10 01:06:05.52637258 +0000 UTC m=+240.251974907" Jun 10 01:06:05.544448 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:05.544379 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" podStartSLOduration=16.544352456 podStartE2EDuration="16.544352456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:05.543013091 +0000 UTC m=+240.268615434" watchObservedRunningTime="2026-06-10 01:06:05.544352456 +0000 UTC m=+240.269954773" Jun 10 01:06:06.163532 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:06.163487 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:06.165975 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:06.165950 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:06.515214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:06.515123 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:06.516373 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:06.516355 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-67dd4c555c-j4dsf" Jun 10 01:06:12.811723 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:12.811692 2554 scope.go:117] "RemoveContainer" containerID="963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9" Jun 10 01:06:13.540593 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:13.540559 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:06:13.540995 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:13.540978 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/1.log" Jun 10 01:06:13.541106 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:13.541017 2554 generic.go:356] "Generic (PLEG): container finished" podID="06081cb6-3657-4e88-a062-ae05eac02ca0" containerID="f266a3e1019f8cca3dd53d7e386928fd7ceec9405318ecb498bafe9a19a66f2e" exitCode=255 Jun 10 01:06:13.541168 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:13.541100 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" event={"ID":"06081cb6-3657-4e88-a062-ae05eac02ca0","Type":"ContainerDied","Data":"f266a3e1019f8cca3dd53d7e386928fd7ceec9405318ecb498bafe9a19a66f2e"} Jun 10 01:06:13.541168 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:13.541156 2554 scope.go:117] "RemoveContainer" containerID="963cca7a41b73665221c11269d2b4587e6ebdd004d19de4343c2bd084583a0e9" Jun 10 01:06:13.541455 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:13.541434 2554 scope.go:117] "RemoveContainer" containerID="f266a3e1019f8cca3dd53d7e386928fd7ceec9405318ecb498bafe9a19a66f2e" Jun 10 01:06:13.541615 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:13.541598 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbc_openshift-console-operator(06081cb6-3657-4e88-a062-ae05eac02ca0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podUID="06081cb6-3657-4e88-a062-ae05eac02ca0" Jun 10 01:06:14.545186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.545157 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:06:14.669634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.669601 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mqcjz"] Jun 10 01:06:14.672138 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.672120 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.674374 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.674350 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pvxg\"" Jun 10 01:06:14.674970 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.674950 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 01:06:14.675521 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.675497 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 01:06:14.675602 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.675535 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 01:06:14.675602 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.675564 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 01:06:14.684220 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.684194 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqcjz"] Jun 10 01:06:14.725228 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.725062 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76bd7f87cc-gx85k"] Jun 10 01:06:14.760160 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.760129 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7999d85f4-m2t6k"] Jun 10 01:06:14.765881 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.765857 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.775438 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.775415 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7999d85f4-m2t6k"] Jun 10 01:06:14.803220 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.803122 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eea8960-304c-429f-b2c1-ddf57191de4a-data-volume\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.803220 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.803177 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4eea8960-304c-429f-b2c1-ddf57191de4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.803410 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.803243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qnkj\" (UniqueName: \"kubernetes.io/projected/4eea8960-304c-429f-b2c1-ddf57191de4a-kube-api-access-5qnkj\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.803410 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.803305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4eea8960-304c-429f-b2c1-ddf57191de4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.803410 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.803349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4eea8960-304c-429f-b2c1-ddf57191de4a-crio-socket\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.903707 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903669 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-registry-tls\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.903707 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903707 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2283b299-1e56-47b3-9fed-83ef34fcdb45-ca-trust-extracted\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903729 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4eea8960-304c-429f-b2c1-ddf57191de4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qnkj\" (UniqueName: \"kubernetes.io/projected/4eea8960-304c-429f-b2c1-ddf57191de4a-kube-api-access-5qnkj\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903771 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2283b299-1e56-47b3-9fed-83ef34fcdb45-image-registry-private-configuration\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903794 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc6m8\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-kube-api-access-lc6m8\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4eea8960-304c-429f-b2c1-ddf57191de4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903917 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4eea8960-304c-429f-b2c1-ddf57191de4a-crio-socket\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.903982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903962 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2283b299-1e56-47b3-9fed-83ef34fcdb45-registry-certificates\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.904290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.903998 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2283b299-1e56-47b3-9fed-83ef34fcdb45-trusted-ca\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.904290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.904023 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4eea8960-304c-429f-b2c1-ddf57191de4a-crio-socket\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.904290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.904025 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2283b299-1e56-47b3-9fed-83ef34fcdb45-installation-pull-secrets\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.904290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.904133 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-bound-sa-token\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:14.904290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.904176 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eea8960-304c-429f-b2c1-ddf57191de4a-data-volume\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.904453 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.904385 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4eea8960-304c-429f-b2c1-ddf57191de4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.904453 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.904436 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4eea8960-304c-429f-b2c1-ddf57191de4a-data-volume\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.906117 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.906100 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4eea8960-304c-429f-b2c1-ddf57191de4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.912055 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.912025 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qnkj\" (UniqueName: \"kubernetes.io/projected/4eea8960-304c-429f-b2c1-ddf57191de4a-kube-api-access-5qnkj\") pod \"insights-runtime-extractor-mqcjz\" (UID: \"4eea8960-304c-429f-b2c1-ddf57191de4a\") " pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:14.980333 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:14.980298 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mqcjz" Jun 10 01:06:15.004576 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.004540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2283b299-1e56-47b3-9fed-83ef34fcdb45-trusted-ca\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.004736 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.004590 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2283b299-1e56-47b3-9fed-83ef34fcdb45-installation-pull-secrets\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.004736 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.004618 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-bound-sa-token\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.005523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.005090 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-registry-tls\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.005523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.005179 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2283b299-1e56-47b3-9fed-83ef34fcdb45-ca-trust-extracted\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.005523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.005228 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2283b299-1e56-47b3-9fed-83ef34fcdb45-image-registry-private-configuration\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.005523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.005276 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc6m8\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-kube-api-access-lc6m8\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.005523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.005392 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2283b299-1e56-47b3-9fed-83ef34fcdb45-registry-certificates\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.005864 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.005676 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2283b299-1e56-47b3-9fed-83ef34fcdb45-ca-trust-extracted\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.006596 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.006286 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2283b299-1e56-47b3-9fed-83ef34fcdb45-trusted-ca\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.006699 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.006629 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2283b299-1e56-47b3-9fed-83ef34fcdb45-registry-certificates\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.008844 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.008813 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2283b299-1e56-47b3-9fed-83ef34fcdb45-installation-pull-secrets\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.012015 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.011959 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2283b299-1e56-47b3-9fed-83ef34fcdb45-image-registry-private-configuration\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.013437 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.013413 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-bound-sa-token\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.013519 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.013499 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-registry-tls\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.013671 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.013649 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc6m8\" (UniqueName: \"kubernetes.io/projected/2283b299-1e56-47b3-9fed-83ef34fcdb45-kube-api-access-lc6m8\") pod \"image-registry-7999d85f4-m2t6k\" (UID: \"2283b299-1e56-47b3-9fed-83ef34fcdb45\") " pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.075437 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.075404 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.112827 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.112785 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mqcjz"] Jun 10 01:06:15.115963 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:15.115935 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eea8960_304c_429f_b2c1_ddf57191de4a.slice/crio-ebf46526268bd1ebf3d1561f4486e81f38863090cca75942815583c0db947fb1 WatchSource:0}: Error finding container ebf46526268bd1ebf3d1561f4486e81f38863090cca75942815583c0db947fb1: Status 404 returned error can't find the container with id ebf46526268bd1ebf3d1561f4486e81f38863090cca75942815583c0db947fb1 Jun 10 01:06:15.224687 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.224664 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7999d85f4-m2t6k"] Jun 10 01:06:15.226930 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:15.226903 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2283b299_1e56_47b3_9fed_83ef34fcdb45.slice/crio-0a05184debfc83229f1b9ad2fa3ee3e4e6913856beb7be5309833fb1031f7364 WatchSource:0}: Error finding container 0a05184debfc83229f1b9ad2fa3ee3e4e6913856beb7be5309833fb1031f7364: Status 404 returned error can't find the container with id 0a05184debfc83229f1b9ad2fa3ee3e4e6913856beb7be5309833fb1031f7364 Jun 10 01:06:15.551159 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.551117 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqcjz" event={"ID":"4eea8960-304c-429f-b2c1-ddf57191de4a","Type":"ContainerStarted","Data":"cbbe1ca933d0ba9b7816843f29a7f8c269b068208f603190ae1250e4ab060bf3"} Jun 10 01:06:15.551634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.551194 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqcjz" event={"ID":"4eea8960-304c-429f-b2c1-ddf57191de4a","Type":"ContainerStarted","Data":"ebf46526268bd1ebf3d1561f4486e81f38863090cca75942815583c0db947fb1"} Jun 10 01:06:15.552814 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.552774 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" event={"ID":"2283b299-1e56-47b3-9fed-83ef34fcdb45","Type":"ContainerStarted","Data":"2a25ad2725b11ee6ee2601f24063cae37ffe6bc5018e1d022e8d8a123144297f"} Jun 10 01:06:15.552914 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.552822 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" event={"ID":"2283b299-1e56-47b3-9fed-83ef34fcdb45","Type":"ContainerStarted","Data":"0a05184debfc83229f1b9ad2fa3ee3e4e6913856beb7be5309833fb1031f7364"} Jun 10 01:06:15.552981 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.552951 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:15.571248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:15.571182 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podStartSLOduration=1.571158492 podStartE2EDuration="1.571158492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:15.56980188 +0000 UTC m=+250.295404231" watchObservedRunningTime="2026-06-10 01:06:15.571158492 +0000 UTC m=+250.296760826" Jun 10 01:06:16.558635 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:16.558599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqcjz" event={"ID":"4eea8960-304c-429f-b2c1-ddf57191de4a","Type":"ContainerStarted","Data":"d472e78522f1833c0804bd8e69571709fad5e601b9fcfb59fc9cbf22ffd29349"} Jun 10 01:06:17.564027 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.563938 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mqcjz" event={"ID":"4eea8960-304c-429f-b2c1-ddf57191de4a","Type":"ContainerStarted","Data":"5308314d88b481b1e798e0f5da380f85d0c1cd039a39424af34df5b0acc64f0d"} Jun 10 01:06:17.581359 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.581303 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mqcjz" podStartSLOduration=1.664810735 podStartE2EDuration="3.581287899s" totalImagesPullingTime="1.916477164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:06:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:17.579584621 +0000 UTC m=+252.305186939" watchObservedRunningTime="2026-06-10 01:06:17.581287899 +0000 UTC m=+252.306890237" Jun 10 01:06:17.629533 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.629501 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:06:17.631798 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.631768 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a7de745-ffdf-4b32-a818-7c023c9a0633-metrics-certs\") pod \"network-metrics-daemon-vbrdw\" (UID: \"9a7de745-ffdf-4b32-a818-7c023c9a0633\") " pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:06:17.716318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.716283 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ll2dx\"" Jun 10 01:06:17.725050 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.725025 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vbrdw" Jun 10 01:06:17.857550 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:17.857530 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vbrdw"] Jun 10 01:06:17.860060 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:17.860034 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7de745_ffdf_4b32_a818_7c023c9a0633.slice/crio-9259f0c277648fac33f692981d418232f09ba80a72dba216f8724d2a44a816dd WatchSource:0}: Error finding container 9259f0c277648fac33f692981d418232f09ba80a72dba216f8724d2a44a816dd: Status 404 returned error can't find the container with id 9259f0c277648fac33f692981d418232f09ba80a72dba216f8724d2a44a816dd Jun 10 01:06:18.569232 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:18.569193 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbrdw" event={"ID":"9a7de745-ffdf-4b32-a818-7c023c9a0633","Type":"ContainerStarted","Data":"9259f0c277648fac33f692981d418232f09ba80a72dba216f8724d2a44a816dd"} Jun 10 01:06:19.574359 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:19.574324 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbrdw" event={"ID":"9a7de745-ffdf-4b32-a818-7c023c9a0633","Type":"ContainerStarted","Data":"898a631bc5756a857ae9652da78661a1a074594f48e1a2fc599ac9856c61666f"} Jun 10 01:06:19.574734 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:19.574383 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vbrdw" event={"ID":"9a7de745-ffdf-4b32-a818-7c023c9a0633","Type":"ContainerStarted","Data":"076f11be72c13dfb133c668ac248ec3a0422355fef22f5b54aa38de18381fc1f"} Jun 10 01:06:19.589069 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:19.589020 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vbrdw" podStartSLOduration=253.727167026 podStartE2EDuration="4m14.589004869s" totalImagesPullingTime="861.837843ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:19.587917658 +0000 UTC m=+254.313519999" watchObservedRunningTime="2026-06-10 01:06:19.589004869 +0000 UTC m=+254.314607186" Jun 10 01:06:19.648935 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:19.648904 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:06:19.649098 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:19.648951 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:06:19.649263 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:19.649249 2554 scope.go:117] "RemoveContainer" containerID="f266a3e1019f8cca3dd53d7e386928fd7ceec9405318ecb498bafe9a19a66f2e" Jun 10 01:06:19.649394 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:19.649376 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbc_openshift-console-operator(06081cb6-3657-4e88-a062-ae05eac02ca0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podUID="06081cb6-3657-4e88-a062-ae05eac02ca0" Jun 10 01:06:21.209155 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.209116 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mpzkz"] Jun 10 01:06:21.211116 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.211099 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.213365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.213344 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 01:06:21.213528 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.213510 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 01:06:21.213585 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.213533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 01:06:21.213585 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.213533 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zxxpm\"" Jun 10 01:06:21.213674 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.213598 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 01:06:21.214415 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.214399 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 01:06:21.214471 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.214427 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 01:06:21.257185 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r59j\" (UniqueName: \"kubernetes.io/projected/7636b318-1ff2-4d47-aaf3-9540bf0ff990-kube-api-access-5r59j\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257185 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-tls\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257216 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-wtmp\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257252 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-sys\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257278 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-textfile\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257296 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257331 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-root\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257350 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.257407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.257391 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7636b318-1ff2-4d47-aaf3-9540bf0ff990-metrics-client-ca\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358065 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r59j\" (UniqueName: \"kubernetes.io/projected/7636b318-1ff2-4d47-aaf3-9540bf0ff990-kube-api-access-5r59j\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358065 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358066 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-tls\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358251 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358115 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-wtmp\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358251 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358135 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-sys\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358251 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358153 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-textfile\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358251 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358168 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358251 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358233 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-sys\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:21.358258 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358290 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-root\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358292 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-wtmp\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:21.358316 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-tls podName:7636b318-1ff2-4d47-aaf3-9540bf0ff990 nodeName:}" failed. No retries permitted until 2026-06-10 01:06:21.858295636 +0000 UTC m=+256.583897933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-tls") pod "node-exporter-mpzkz" (UID: "7636b318-1ff2-4d47-aaf3-9540bf0ff990") : secret "node-exporter-tls" not found Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358321 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7636b318-1ff2-4d47-aaf3-9540bf0ff990-root\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358378 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358416 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7636b318-1ff2-4d47-aaf3-9540bf0ff990-metrics-client-ca\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358789 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358534 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-textfile\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358850 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358832 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7636b318-1ff2-4d47-aaf3-9540bf0ff990-metrics-client-ca\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.358891 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.358859 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-accelerators-collector-config\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.360518 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.360495 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.369766 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.369746 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r59j\" (UniqueName: \"kubernetes.io/projected/7636b318-1ff2-4d47-aaf3-9540bf0ff990-kube-api-access-5r59j\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.862631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.862595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-tls\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:21.864894 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:21.864870 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7636b318-1ff2-4d47-aaf3-9540bf0ff990-node-exporter-tls\") pod \"node-exporter-mpzkz\" (UID: \"7636b318-1ff2-4d47-aaf3-9540bf0ff990\") " pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:22.120442 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:22.120332 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mpzkz" Jun 10 01:06:22.129269 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:22.129242 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7636b318_1ff2_4d47_aaf3_9540bf0ff990.slice/crio-04851ae9c5fc43bf0060995848b3255f7d56635fef09660bef367949d8da89bf WatchSource:0}: Error finding container 04851ae9c5fc43bf0060995848b3255f7d56635fef09660bef367949d8da89bf: Status 404 returned error can't find the container with id 04851ae9c5fc43bf0060995848b3255f7d56635fef09660bef367949d8da89bf Jun 10 01:06:22.584779 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:22.584734 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpzkz" event={"ID":"7636b318-1ff2-4d47-aaf3-9540bf0ff990","Type":"ContainerStarted","Data":"04851ae9c5fc43bf0060995848b3255f7d56635fef09660bef367949d8da89bf"} Jun 10 01:06:23.589594 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:23.589562 2554 generic.go:356] "Generic (PLEG): container finished" podID="7636b318-1ff2-4d47-aaf3-9540bf0ff990" containerID="3ea01c9631255ac5e8bb57dc149bfa711885055aba259c4aa51f45eaf5c4841f" exitCode=0 Jun 10 01:06:23.589947 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:23.589632 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpzkz" event={"ID":"7636b318-1ff2-4d47-aaf3-9540bf0ff990","Type":"ContainerDied","Data":"3ea01c9631255ac5e8bb57dc149bfa711885055aba259c4aa51f45eaf5c4841f"} Jun 10 01:06:24.594586 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:24.594544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpzkz" event={"ID":"7636b318-1ff2-4d47-aaf3-9540bf0ff990","Type":"ContainerStarted","Data":"0d27a1d25d5316d7d557fcee2440b7d2c91f800a743bd7afbce93a0758bca2e6"} Jun 10 01:06:24.594976 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:24.594609 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mpzkz" event={"ID":"7636b318-1ff2-4d47-aaf3-9540bf0ff990","Type":"ContainerStarted","Data":"1beb73b207b0dde63b680b858ca9b95d6fb096e804df793c16a08abe1a18e572"} Jun 10 01:06:24.613030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:24.612970 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mpzkz" podStartSLOduration=2.658945963 podStartE2EDuration="3.612952344s" totalImagesPullingTime="889.069995ms" totalInitContainerRuntime="64.936386ms" isStatefulPod=true podCreationTimestamp="2026-06-10 01:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:24.611041928 +0000 UTC m=+259.336644257" watchObservedRunningTime="2026-06-10 01:06:24.612952344 +0000 UTC m=+259.338554661" Jun 10 01:06:24.731750 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:24.731713 2554 patch_prober.go:28] interesting pod/image-registry-76bd7f87cc-gx85k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:24.731901 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:24.731768 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:27.471271 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.471240 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:06:27.473714 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.473695 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.476146 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476125 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 01:06:27.476146 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476125 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 01:06:27.476430 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476408 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 01:06:27.476430 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476421 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 01:06:27.476570 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476437 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 01:06:27.476570 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476447 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 01:06:27.476570 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476559 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 01:06:27.476758 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476582 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 01:06:27.476976 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476951 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 01:06:27.476976 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476972 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cvqs0nvkmqjd5\"" Jun 10 01:06:27.477147 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476950 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kkm95\"" Jun 10 01:06:27.477147 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476952 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 01:06:27.477147 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476978 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 01:06:27.477147 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.476954 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 01:06:27.477384 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.477369 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 01:06:27.477674 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.477658 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 01:06:27.478753 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.478732 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 01:06:27.489751 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.489727 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:06:27.505462 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505431 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505462 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505466 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx4tf\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-kube-api-access-tx4tf\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505493 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505514 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505530 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505547 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505565 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505592 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505634 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505623 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505704 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505731 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505777 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505792 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.505836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.506012 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.506012 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.506012 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.506012 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.506012 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.505924 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.606777 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.606777 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606784 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606802 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606855 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606904 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606950 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606976 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.606995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607015 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607043 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607069 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx4tf\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-kube-api-access-tx4tf\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607155 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607180 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607210 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607236 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607273 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.607502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607285 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.608056 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.607688 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.608134 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.608060 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.608997 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.608672 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.610178 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610026 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config-out\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.610293 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610220 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.610748 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610494 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.610748 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610566 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610753 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610929 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.610932 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.611209 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.611325 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.611386 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.611871 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.612899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.612752 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.613358 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.613129 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.613504 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.613485 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-web-config\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.613855 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.613835 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.617407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.617385 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx4tf\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-kube-api-access-tx4tf\") pod \"prometheus-k8s-0\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.783507 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.783412 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:27.917771 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:27.917738 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:06:27.921471 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:27.921443 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda662bde7_d33a_4a08_8ac9_a18d8eb40b1c.slice/crio-56ed324141b6749a3b384229dfcb7fce41c4ff2c8bacac1af3eb02d59bc92a1c WatchSource:0}: Error finding container 56ed324141b6749a3b384229dfcb7fce41c4ff2c8bacac1af3eb02d59bc92a1c: Status 404 returned error can't find the container with id 56ed324141b6749a3b384229dfcb7fce41c4ff2c8bacac1af3eb02d59bc92a1c Jun 10 01:06:28.609881 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:28.609842 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"56ed324141b6749a3b384229dfcb7fce41c4ff2c8bacac1af3eb02d59bc92a1c"} Jun 10 01:06:29.614435 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:29.614402 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="36181e79b1fa950003fea029acf42ba74a3ab7bd7f9c87979361b2054a1bd44f" exitCode=0 Jun 10 01:06:29.614813 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:29.614487 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"36181e79b1fa950003fea029acf42ba74a3ab7bd7f9c87979361b2054a1bd44f"} Jun 10 01:06:29.812320 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:29.812289 2554 scope.go:117] "RemoveContainer" containerID="f266a3e1019f8cca3dd53d7e386928fd7ceec9405318ecb498bafe9a19a66f2e" Jun 10 01:06:29.812500 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:29.812475 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-mnnbc_openshift-console-operator(06081cb6-3657-4e88-a062-ae05eac02ca0)\"" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podUID="06081cb6-3657-4e88-a062-ae05eac02ca0" Jun 10 01:06:32.635033 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:32.634877 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"18ca462d504b115731afadd7430d59a5e68346038b0daf93178e89059f5ab9cf"} Jun 10 01:06:32.635033 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:32.634967 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"d14c828815222ae742beccdb9ccf9e83d4c13f2763978a236e33dd905413dbb5"} Jun 10 01:06:34.645390 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.645358 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"3460b3e47e172eac0c27ac06554eea229086be183f8123949d11cb5f8b0afba2"} Jun 10 01:06:34.645773 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.645419 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"3a77f0536143b3d118bb8e874b9f6558f6d040968159615d4fa58ef4172f3dc9"} Jun 10 01:06:34.645773 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.645444 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"b824d94b35e1aa36a3163fb11925e8b31f7b47417923f58a006661c833c9618e"} Jun 10 01:06:34.645773 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.645469 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerStarted","Data":"7cc3a3b13174b17f6ee3fee7b0b5423d9568ef61a4afa40b092af00ebb792aa2"} Jun 10 01:06:34.673630 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.673573 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.128008513 podStartE2EDuration="7.673552546s" totalImagesPullingTime="5.525022873s" totalInitContainerRuntime="20.52116ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:06:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:34.670784528 +0000 UTC m=+269.396386846" watchObservedRunningTime="2026-06-10 01:06:34.673552546 +0000 UTC m=+269.399154884" Jun 10 01:06:34.729756 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.729718 2554 patch_prober.go:28] interesting pod/image-registry-76bd7f87cc-gx85k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:34.729926 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:34.729779 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:35.079852 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:35.079772 2554 patch_prober.go:28] interesting pod/image-registry-7999d85f4-m2t6k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:35.079852 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:35.079827 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:36.562637 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:36.562599 2554 patch_prober.go:28] interesting pod/image-registry-7999d85f4-m2t6k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:36.563005 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:36.562658 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:37.784204 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:37.784145 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:06:39.745360 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:39.745288 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerName="registry" containerID="cri-o://505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3" gracePeriod=30 Jun 10 01:06:39.979070 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:39.979037 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:06:40.115235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115143 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-bound-sa-token\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115194 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-certificates\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115213 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-trusted-ca\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115229 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115277 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-ca-trust-extracted\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115303 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw2k5\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-kube-api-access-gw2k5\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115329 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-image-registry-private-configuration\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115375 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-installation-pull-secrets\") pod \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\" (UID: \"c9378dab-a295-4d92-92b7-1b5ce5c86c4d\") " Jun 10 01:06:40.115759 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.115642 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:06:40.116146 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.116122 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:06:40.118069 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.118020 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:06:40.118180 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.118068 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-kube-api-access-gw2k5" (OuterVolumeSpecName: "kube-api-access-gw2k5") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "kube-api-access-gw2k5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:06:40.118180 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.118113 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:06:40.118180 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.118144 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:06:40.118287 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.118205 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:06:40.123719 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.123690 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c9378dab-a295-4d92-92b7-1b5ce5c86c4d" (UID: "c9378dab-a295-4d92-92b7-1b5ce5c86c4d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:06:40.216617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216573 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw2k5\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-kube-api-access-gw2k5\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216610 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-image-registry-private-configuration\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216625 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-installation-pull-secrets\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216867 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216638 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-bound-sa-token\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216867 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216651 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-certificates\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216867 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216662 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-trusted-ca\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216867 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216672 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-registry-tls\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.216867 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.216682 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c9378dab-a295-4d92-92b7-1b5ce5c86c4d-ca-trust-extracted\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:06:40.669990 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.669956 2554 generic.go:356] "Generic (PLEG): container finished" podID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerID="505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3" exitCode=0 Jun 10 01:06:40.670187 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.670001 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" Jun 10 01:06:40.670187 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.670016 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" event={"ID":"c9378dab-a295-4d92-92b7-1b5ce5c86c4d","Type":"ContainerDied","Data":"505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3"} Jun 10 01:06:40.670187 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.670061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76bd7f87cc-gx85k" event={"ID":"c9378dab-a295-4d92-92b7-1b5ce5c86c4d","Type":"ContainerDied","Data":"95bc7434c9227fe27358e33d06bc293c84567f181c3a5ac25de1c36465a76acd"} Jun 10 01:06:40.670187 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.670102 2554 scope.go:117] "RemoveContainer" containerID="505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3" Jun 10 01:06:40.678360 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.678343 2554 scope.go:117] "RemoveContainer" containerID="505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3" Jun 10 01:06:40.678617 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:40.678596 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3\": container with ID starting with 505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3 not found: ID does not exist" containerID="505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3" Jun 10 01:06:40.678661 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.678625 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3"} err="failed to get container status \"505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3\": rpc error: code = NotFound desc = could not find container \"505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3\": container with ID starting with 505e984a0e32bad6bdc96a7fdc1c28881e50c75d5c7ad27454b672b4f264bab3 not found: ID does not exist" Jun 10 01:06:40.689582 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.689558 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76bd7f87cc-gx85k"] Jun 10 01:06:40.692370 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:40.692338 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76bd7f87cc-gx85k"] Jun 10 01:06:41.811747 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:41.811714 2554 scope.go:117] "RemoveContainer" containerID="f266a3e1019f8cca3dd53d7e386928fd7ceec9405318ecb498bafe9a19a66f2e" Jun 10 01:06:41.816087 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:41.816045 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" path="/var/lib/kubelet/pods/c9378dab-a295-4d92-92b7-1b5ce5c86c4d/volumes" Jun 10 01:06:42.680218 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:42.680192 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:06:42.680392 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:42.680268 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" event={"ID":"06081cb6-3657-4e88-a062-ae05eac02ca0","Type":"ContainerStarted","Data":"10c3b4ac64cb05b0af4fc7ef605ef53ec4894a9d578a36901d8f94ec06fc49bb"} Jun 10 01:06:42.680549 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:42.680531 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:06:42.685219 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:42.685195 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" Jun 10 01:06:42.696300 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:42.696249 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-mnnbc" podStartSLOduration=50.703466053 podStartE2EDuration="53.696236381s" totalImagesPullingTime="2.992770328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:42.694881127 +0000 UTC m=+277.420483472" watchObservedRunningTime="2026-06-10 01:06:42.696236381 +0000 UTC m=+277.421838697" Jun 10 01:06:45.080388 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:45.080345 2554 patch_prober.go:28] interesting pod/image-registry-7999d85f4-m2t6k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:45.080871 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:45.080412 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:46.261575 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:46.261529 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-b6j5k" podUID="aef9794f-16e4-49f4-9942-992cdf29dcb5" Jun 10 01:06:46.562895 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:46.562813 2554 patch_prober.go:28] interesting pod/image-registry-7999d85f4-m2t6k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:46.562895 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:46.562864 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:46.695676 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:46.695645 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6j5k" Jun 10 01:06:50.101464 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:50.101427 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:06:50.103776 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:50.103754 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/aef9794f-16e4-49f4-9942-992cdf29dcb5-metrics-tls\") pod \"dns-default-b6j5k\" (UID: \"aef9794f-16e4-49f4-9942-992cdf29dcb5\") " pod="openshift-dns/dns-default-b6j5k" Jun 10 01:06:50.303296 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:50.299450 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qp2m2\"" Jun 10 01:06:50.307034 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:50.307009 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6j5k" Jun 10 01:06:50.435962 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:50.435797 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6j5k"] Jun 10 01:06:50.438478 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:06:50.438450 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaef9794f_16e4_49f4_9942_992cdf29dcb5.slice/crio-30fc8349141698c92d36d28dd1f51bf61255898dabd6f10e2eb862f497d21572 WatchSource:0}: Error finding container 30fc8349141698c92d36d28dd1f51bf61255898dabd6f10e2eb862f497d21572: Status 404 returned error can't find the container with id 30fc8349141698c92d36d28dd1f51bf61255898dabd6f10e2eb862f497d21572 Jun 10 01:06:50.711018 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:50.710981 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6j5k" event={"ID":"aef9794f-16e4-49f4-9942-992cdf29dcb5","Type":"ContainerStarted","Data":"30fc8349141698c92d36d28dd1f51bf61255898dabd6f10e2eb862f497d21572"} Jun 10 01:06:51.716669 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:51.716597 2554 generic.go:356] "Generic (PLEG): container finished" podID="81f3552d-825f-4024-90e7-b5e714be4f8b" containerID="4ad2bd6eee8ab3c42d09cc501e2ca6408e0cde6eacfaa75d64e0e6536bf95740" exitCode=255 Jun 10 01:06:51.717061 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:51.716670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" event={"ID":"81f3552d-825f-4024-90e7-b5e714be4f8b","Type":"ContainerDied","Data":"4ad2bd6eee8ab3c42d09cc501e2ca6408e0cde6eacfaa75d64e0e6536bf95740"} Jun 10 01:06:51.717061 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:51.716721 2554 scope.go:117] "RemoveContainer" containerID="500df660c7647612bf9db4ac1d75a4937a5b2c2f98d357a7b975b1c50cac3d3d" Jun 10 01:06:51.724556 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:51.724535 2554 scope.go:117] "RemoveContainer" containerID="4ad2bd6eee8ab3c42d09cc501e2ca6408e0cde6eacfaa75d64e0e6536bf95740" Jun 10 01:06:51.724722 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:51.724704 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-658778f598-8m8s7_open-cluster-management-agent-addon(81f3552d-825f-4024-90e7-b5e714be4f8b)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" podUID="81f3552d-825f-4024-90e7-b5e714be4f8b" Jun 10 01:06:52.722501 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:52.722408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6j5k" event={"ID":"aef9794f-16e4-49f4-9942-992cdf29dcb5","Type":"ContainerStarted","Data":"80e3e2077406efd9daf9566be476c692e95bb6e535d6d3717b953df799345fa8"} Jun 10 01:06:52.722501 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:52.722460 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6j5k" event={"ID":"aef9794f-16e4-49f4-9942-992cdf29dcb5","Type":"ContainerStarted","Data":"5e0265bd3fd91176301785f5b50a95ba8b2d9221792567496150efd2a0d0999f"} Jun 10 01:06:52.722962 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:52.722509 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b6j5k" Jun 10 01:06:52.741159 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:52.741106 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b6j5k" podStartSLOduration=250.720330329 podStartE2EDuration="4m12.741089264s" totalImagesPullingTime="2.020758935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:06:52.739311252 +0000 UTC m=+287.464913568" watchObservedRunningTime="2026-06-10 01:06:52.741089264 +0000 UTC m=+287.466691573" Jun 10 01:06:55.079324 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:55.079284 2554 patch_prober.go:28] interesting pod/image-registry-7999d85f4-m2t6k container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:55.079696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:55.079339 2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:55.079696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:55.079384 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:06:55.079850 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:55.079829 2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"2a25ad2725b11ee6ee2601f24063cae37ffe6bc5018e1d022e8d8a123144297f"} pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 01:06:55.083488 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:55.083463 2554 patch_prober.go:28] interesting pod/image-registry-7999d85f4-m2t6k container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 01:06:55.083642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:55.083506 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:06:57.109500 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:57.109459 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" Jun 10 01:06:57.109893 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:06:57.109807 2554 scope.go:117] "RemoveContainer" containerID="4ad2bd6eee8ab3c42d09cc501e2ca6408e0cde6eacfaa75d64e0e6536bf95740" Jun 10 01:06:57.109988 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:06:57.109965 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-658778f598-8m8s7_open-cluster-management-agent-addon(81f3552d-825f-4024-90e7-b5e714be4f8b)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" podUID="81f3552d-825f-4024-90e7-b5e714be4f8b" Jun 10 01:07:02.730350 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:02.730316 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b6j5k" Jun 10 01:07:05.084504 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:05.084475 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:07:05.745925 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:05.745272 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:07:05.745925 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:05.745346 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:07:05.752866 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:05.752843 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:07:05.753006 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:05.752986 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:07:05.757817 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:05.757795 2554 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 01:07:12.817002 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:12.816974 2554 scope.go:117] "RemoveContainer" containerID="4ad2bd6eee8ab3c42d09cc501e2ca6408e0cde6eacfaa75d64e0e6536bf95740" Jun 10 01:07:13.801903 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:13.801868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-658778f598-8m8s7" event={"ID":"81f3552d-825f-4024-90e7-b5e714be4f8b","Type":"ContainerStarted","Data":"d1ea59fc83342400f6e70768117009efb20f115e0802d2f9f32e04694defa51c"} Jun 10 01:07:19.783372 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:19.783334 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpzkz_7636b318-1ff2-4d47-aaf3-9540bf0ff990/init-textfile/0.log" Jun 10 01:07:19.984603 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:19.984574 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpzkz_7636b318-1ff2-4d47-aaf3-9540bf0ff990/node-exporter/0.log" Jun 10 01:07:20.099586 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:20.099501 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" podUID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerName="registry" containerID="cri-o://2a25ad2725b11ee6ee2601f24063cae37ffe6bc5018e1d022e8d8a123144297f" gracePeriod=30 Jun 10 01:07:20.183348 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:20.183319 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpzkz_7636b318-1ff2-4d47-aaf3-9540bf0ff990/kube-rbac-proxy/0.log" Jun 10 01:07:20.983708 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:20.983683 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/init-config-reloader/0.log" Jun 10 01:07:21.185300 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.185269 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/prometheus/0.log" Jun 10 01:07:21.383988 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.383960 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/config-reloader/0.log" Jun 10 01:07:21.583859 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.583783 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/thanos-sidecar/0.log" Jun 10 01:07:21.784615 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.784587 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/kube-rbac-proxy-web/0.log" Jun 10 01:07:21.831457 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.831422 2554 generic.go:356] "Generic (PLEG): container finished" podID="2283b299-1e56-47b3-9fed-83ef34fcdb45" containerID="2a25ad2725b11ee6ee2601f24063cae37ffe6bc5018e1d022e8d8a123144297f" exitCode=0 Jun 10 01:07:21.831653 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.831489 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" event={"ID":"2283b299-1e56-47b3-9fed-83ef34fcdb45","Type":"ContainerDied","Data":"2a25ad2725b11ee6ee2601f24063cae37ffe6bc5018e1d022e8d8a123144297f"} Jun 10 01:07:21.831653 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.831527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" event={"ID":"2283b299-1e56-47b3-9fed-83ef34fcdb45","Type":"ContainerStarted","Data":"8c358f80771b40aa6cdc459b33ddfbdd9771b255d03ab3ef9feadf16a0bcd0d7"} Jun 10 01:07:21.831653 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.831561 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:07:21.984381 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:21.984348 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/kube-rbac-proxy/0.log" Jun 10 01:07:22.183321 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:22.183286 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/kube-rbac-proxy-thanos/0.log" Jun 10 01:07:24.383249 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:24.383215 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:07:24.585217 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:24.585173 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/3.log" Jun 10 01:07:25.384536 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:25.384505 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dd4c555c-j4dsf_deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3/router/0.log" Jun 10 01:07:25.583631 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:25.583604 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6g2wj_6e1ba28c-a48d-471b-877f-289a45e7e43c/serve-healthcheck-canary/0.log" Jun 10 01:07:27.783973 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:27.783939 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:27.800782 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:27.800754 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:27.871873 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:27.871835 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:42.839951 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:42.839920 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7999d85f4-m2t6k" Jun 10 01:07:45.798253 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798212 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:07:45.798663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798490 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="prometheus" containerID="cri-o://d14c828815222ae742beccdb9ccf9e83d4c13f2763978a236e33dd905413dbb5" gracePeriod=600 Jun 10 01:07:45.798663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798526 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="thanos-sidecar" containerID="cri-o://7cc3a3b13174b17f6ee3fee7b0b5423d9568ef61a4afa40b092af00ebb792aa2" gracePeriod=600 Jun 10 01:07:45.798663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798566 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3460b3e47e172eac0c27ac06554eea229086be183f8123949d11cb5f8b0afba2" gracePeriod=600 Jun 10 01:07:45.798663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798510 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy" containerID="cri-o://3a77f0536143b3d118bb8e874b9f6558f6d040968159615d4fa58ef4172f3dc9" gracePeriod=600 Jun 10 01:07:45.798663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798591 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="config-reloader" containerID="cri-o://18ca462d504b115731afadd7430d59a5e68346038b0daf93178e89059f5ab9cf" gracePeriod=600 Jun 10 01:07:45.798663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.798552 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-web" containerID="cri-o://b824d94b35e1aa36a3163fb11925e8b31f7b47417923f58a006661c833c9618e" gracePeriod=600 Jun 10 01:07:45.927468 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927435 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="3460b3e47e172eac0c27ac06554eea229086be183f8123949d11cb5f8b0afba2" exitCode=0 Jun 10 01:07:45.927468 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927467 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="3a77f0536143b3d118bb8e874b9f6558f6d040968159615d4fa58ef4172f3dc9" exitCode=0 Jun 10 01:07:45.927617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927476 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="7cc3a3b13174b17f6ee3fee7b0b5423d9568ef61a4afa40b092af00ebb792aa2" exitCode=0 Jun 10 01:07:45.927617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927484 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="18ca462d504b115731afadd7430d59a5e68346038b0daf93178e89059f5ab9cf" exitCode=0 Jun 10 01:07:45.927617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927494 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="d14c828815222ae742beccdb9ccf9e83d4c13f2763978a236e33dd905413dbb5" exitCode=0 Jun 10 01:07:45.927617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927504 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"3460b3e47e172eac0c27ac06554eea229086be183f8123949d11cb5f8b0afba2"} Jun 10 01:07:45.927617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927570 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"3a77f0536143b3d118bb8e874b9f6558f6d040968159615d4fa58ef4172f3dc9"} Jun 10 01:07:45.927617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927597 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"7cc3a3b13174b17f6ee3fee7b0b5423d9568ef61a4afa40b092af00ebb792aa2"} Jun 10 01:07:45.927792 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"18ca462d504b115731afadd7430d59a5e68346038b0daf93178e89059f5ab9cf"} Jun 10 01:07:45.927792 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:45.927654 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"d14c828815222ae742beccdb9ccf9e83d4c13f2763978a236e33dd905413dbb5"} Jun 10 01:07:46.935205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:46.935169 2554 generic.go:356] "Generic (PLEG): container finished" podID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerID="b824d94b35e1aa36a3163fb11925e8b31f7b47417923f58a006661c833c9618e" exitCode=0 Jun 10 01:07:46.935205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:46.935195 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"b824d94b35e1aa36a3163fb11925e8b31f7b47417923f58a006661c833c9618e"} Jun 10 01:07:47.045687 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.045658 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:47.148248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148165 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-metrics-client-certs\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148204 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx4tf\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-kube-api-access-tx4tf\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148228 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148249 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-1\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148274 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-kubelet-serving-ca-bundle\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148304 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-kube-rbac-proxy\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148355 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-thanos-prometheus-http-client-file\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148389 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-web-config\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148421 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-0\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148454 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148476 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-tls-assets\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148500 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-db\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.148547 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148538 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-trusted-ca-bundle\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148574 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-2\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148605 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-tls\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148630 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-metrics-client-ca\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148653 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config-out\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148685 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-serving-certs-ca-bundle\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148723 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149023 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148746 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-grpc-tls\") pod \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\" (UID: \"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c\") " Jun 10 01:07:47.149537 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148648 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.149620 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.148771 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.149620 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.149506 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.150228 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.150199 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:07:47.150707 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.150484 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.150925 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.150898 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.151035 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.150942 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.151326 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.151300 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:07:47.151412 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.151314 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.151611 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.151581 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.152411 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.152381 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.152745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.152720 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.153115 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.153069 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config-out" (OuterVolumeSpecName: "config-out") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:07:47.153410 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.153373 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:47.153490 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.153438 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.153561 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.153535 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-kube-api-access-tx4tf" (OuterVolumeSpecName: "kube-api-access-tx4tf") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "kube-api-access-tx4tf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:07:47.153561 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.153540 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.153917 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.153891 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config" (OuterVolumeSpecName: "config") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.154560 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.154538 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.162947 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.162921 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-web-config" (OuterVolumeSpecName: "web-config") pod "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" (UID: "a662bde7-d33a-4a08-8ac9-a18d8eb40b1c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:07:47.250144 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250098 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-web-config\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250144 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250140 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250144 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250153 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250144 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250164 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-tls-assets\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250172 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-db\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250181 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250190 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250198 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250206 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-metrics-client-ca\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250214 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config-out\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250222 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250229 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-config\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250238 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-grpc-tls\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250246 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-metrics-client-certs\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250253 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx4tf\" (UniqueName: \"kubernetes.io/projected/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-kube-api-access-tx4tf\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250263 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250272 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250281 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250289 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-secret-kube-rbac-proxy\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.250396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.250297 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:07:47.941635 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.941598 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a662bde7-d33a-4a08-8ac9-a18d8eb40b1c","Type":"ContainerDied","Data":"56ed324141b6749a3b384229dfcb7fce41c4ff2c8bacac1af3eb02d59bc92a1c"} Jun 10 01:07:47.941635 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.941627 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:47.942109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.941681 2554 scope.go:117] "RemoveContainer" containerID="3460b3e47e172eac0c27ac06554eea229086be183f8123949d11cb5f8b0afba2" Jun 10 01:07:47.949205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.949186 2554 scope.go:117] "RemoveContainer" containerID="3a77f0536143b3d118bb8e874b9f6558f6d040968159615d4fa58ef4172f3dc9" Jun 10 01:07:47.955751 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.955735 2554 scope.go:117] "RemoveContainer" containerID="b824d94b35e1aa36a3163fb11925e8b31f7b47417923f58a006661c833c9618e" Jun 10 01:07:47.960992 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.960969 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:07:47.962532 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.962515 2554 scope.go:117] "RemoveContainer" containerID="7cc3a3b13174b17f6ee3fee7b0b5423d9568ef61a4afa40b092af00ebb792aa2" Jun 10 01:07:47.964709 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.964688 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:07:47.969362 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.969345 2554 scope.go:117] "RemoveContainer" containerID="18ca462d504b115731afadd7430d59a5e68346038b0daf93178e89059f5ab9cf" Jun 10 01:07:47.975738 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.975720 2554 scope.go:117] "RemoveContainer" containerID="d14c828815222ae742beccdb9ccf9e83d4c13f2763978a236e33dd905413dbb5" Jun 10 01:07:47.982701 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.982682 2554 scope.go:117] "RemoveContainer" containerID="36181e79b1fa950003fea029acf42ba74a3ab7bd7f9c87979361b2054a1bd44f" Jun 10 01:07:47.989254 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989200 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:07:47.989460 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989447 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-thanos" Jun 10 01:07:47.989494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989462 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-thanos" Jun 10 01:07:47.989494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989472 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerName="registry" Jun 10 01:07:47.989494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989477 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerName="registry" Jun 10 01:07:47.989494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989493 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="config-reloader" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989498 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="config-reloader" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989504 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="thanos-sidecar" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989509 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="thanos-sidecar" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989516 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="init-config-reloader" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989522 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="init-config-reloader" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989529 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="prometheus" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989535 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="prometheus" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989541 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-web" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989546 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-web" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989552 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989557 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989595 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9378dab-a295-4d92-92b7-1b5ce5c86c4d" containerName="registry" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989602 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="thanos-sidecar" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989608 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="config-reloader" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989614 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="prometheus" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989620 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-web" Jun 10 01:07:47.989618 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989625 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy" Jun 10 01:07:47.990093 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.989631 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" containerName="kube-rbac-proxy-thanos" Jun 10 01:07:47.994522 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.994505 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:47.996562 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.996541 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 01:07:47.996655 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.996556 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 01:07:47.997017 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.996970 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 01:07:47.997017 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.996988 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 01:07:47.997017 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.996999 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997022 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997032 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997036 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kkm95\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.996974 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997227 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997291 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997352 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 01:07:47.997449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997402 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 01:07:47.997943 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997605 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 01:07:47.997943 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.997656 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cvqs0nvkmqjd5\"" Jun 10 01:07:47.999282 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:47.999265 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 01:07:48.003014 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.002993 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 01:07:48.007581 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.007560 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:07:48.054626 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054597 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-config\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.054626 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.054839 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054650 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.054839 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054702 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.054839 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.054839 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054782 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.054839 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054807 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf729\" (UniqueName: \"kubernetes.io/projected/463dc17c-ef5b-4b82-baea-a8320a88a335-kube-api-access-nf729\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-web-config\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/463dc17c-ef5b-4b82-baea-a8320a88a335-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054936 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054957 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.054981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055043 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055013 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055044 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055122 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055156 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055184 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.055365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.055210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/463dc17c-ef5b-4b82-baea-a8320a88a335-config-out\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156189 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156355 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156355 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156215 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156355 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156240 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156505 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf729\" (UniqueName: \"kubernetes.io/projected/463dc17c-ef5b-4b82-baea-a8320a88a335-kube-api-access-nf729\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156505 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156406 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-web-config\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156589 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156571 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156643 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/463dc17c-ef5b-4b82-baea-a8320a88a335-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156643 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156636 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156783 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156783 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156702 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156783 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156783 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.156783 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156782 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156809 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156836 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156873 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156900 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/463dc17c-ef5b-4b82-baea-a8320a88a335-config-out\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.156970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-config\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157030 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.157006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.157748 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.157722 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.158433 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.158405 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.159306 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.159244 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.159542 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.159520 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.159604 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.159540 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.159604 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.159571 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/463dc17c-ef5b-4b82-baea-a8320a88a335-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.159912 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.159892 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-web-config\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.160127 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.160104 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.160207 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.160174 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.160207 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.160190 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.160617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.160593 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.160709 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.160627 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.161017 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.160842 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.161320 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.161287 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/463dc17c-ef5b-4b82-baea-a8320a88a335-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.162199 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.162170 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/463dc17c-ef5b-4b82-baea-a8320a88a335-config-out\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.162576 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.162550 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.162851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.162819 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.163220 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.163199 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.163306 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.163247 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/463dc17c-ef5b-4b82-baea-a8320a88a335-config\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.164112 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.164093 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf729\" (UniqueName: \"kubernetes.io/projected/463dc17c-ef5b-4b82-baea-a8320a88a335-kube-api-access-nf729\") pod \"prometheus-k8s-0\" (UID: \"463dc17c-ef5b-4b82-baea-a8320a88a335\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.304779 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.304743 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:07:48.443409 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.443315 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 01:07:48.447792 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:07:48.447749 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod463dc17c_ef5b_4b82_baea_a8320a88a335.slice/crio-f64d8f1cf250f8ea0bd14b7c087f44e73ae0995afa40b34a1325d7e105e8fe03 WatchSource:0}: Error finding container f64d8f1cf250f8ea0bd14b7c087f44e73ae0995afa40b34a1325d7e105e8fe03: Status 404 returned error can't find the container with id f64d8f1cf250f8ea0bd14b7c087f44e73ae0995afa40b34a1325d7e105e8fe03 Jun 10 01:07:48.947113 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.947062 2554 generic.go:356] "Generic (PLEG): container finished" podID="463dc17c-ef5b-4b82-baea-a8320a88a335" containerID="83d46c38bce793ec0b3435320d0fd0f5b766f3b0876dd700bfca02888ab39f61" exitCode=0 Jun 10 01:07:48.947113 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.947107 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerDied","Data":"83d46c38bce793ec0b3435320d0fd0f5b766f3b0876dd700bfca02888ab39f61"} Jun 10 01:07:48.947535 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:48.947172 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"f64d8f1cf250f8ea0bd14b7c087f44e73ae0995afa40b34a1325d7e105e8fe03"} Jun 10 01:07:49.816587 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.816554 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a662bde7-d33a-4a08-8ac9-a18d8eb40b1c" path="/var/lib/kubelet/pods/a662bde7-d33a-4a08-8ac9-a18d8eb40b1c/volumes" Jun 10 01:07:49.953139 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953116 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:07:49.953539 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953501 2554 generic.go:356] "Generic (PLEG): container finished" podID="463dc17c-ef5b-4b82-baea-a8320a88a335" containerID="894989862abc76389b2731294a186e3d9be4e782ae0eb45507a09ccda24d3b34" exitCode=2 Jun 10 01:07:49.953592 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"3fa05ae75c1717c74a8442e82e544b7a0142d86f6d697d75ef253dabe3c5b400"} Jun 10 01:07:49.953632 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953614 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"f47f778c4570c91654707e264d7a730ff0d226a809a793b16d05dcabb82a67a5"} Jun 10 01:07:49.953670 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953639 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"4bf06a524951da42459255137abd58ab4b9c50d53e04dd532a7ee6eae8d9a48c"} Jun 10 01:07:49.953702 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953670 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"2a69273ea584888b6da7e6ce4a5eb31b957eadaa7fbd52ad098bddecce04c344"} Jun 10 01:07:49.953702 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953694 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"3a49c5b42229a8763daa1d4769f33f12df79e4b9cdc57b3bf2520351eae23f23"} Jun 10 01:07:49.953760 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.953718 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerDied","Data":"894989862abc76389b2731294a186e3d9be4e782ae0eb45507a09ccda24d3b34"} Jun 10 01:07:49.954016 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:49.954002 2554 scope.go:117] "RemoveContainer" containerID="894989862abc76389b2731294a186e3d9be4e782ae0eb45507a09ccda24d3b34" Jun 10 01:07:50.961131 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:50.961105 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:07:50.961603 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:50.961576 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"463dc17c-ef5b-4b82-baea-a8320a88a335","Type":"ContainerStarted","Data":"8737a06cbafb99542b0919520af5ea2028b3a578916f6b000546f0283b7cc165"} Jun 10 01:07:50.989649 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:50.989599 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.969935312 podStartE2EDuration="3.989582584s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.647272ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:07:50.986956801 +0000 UTC m=+345.712559131" watchObservedRunningTime="2026-06-10 01:07:50.989582584 +0000 UTC m=+345.715184900" Jun 10 01:07:53.305671 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:07:53.305585 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:08:48.305474 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:08:48.305437 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:08:48.320890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:08:48.320853 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:08:49.181895 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:08:49.181868 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 01:11:09.566027 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.565984 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn"] Jun 10 01:11:09.569057 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.569033 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.571557 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.571537 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 01:11:09.571678 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.571584 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 01:11:09.571973 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.571956 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 01:11:09.585917 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.585884 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 01:11:09.586050 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.585884 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kdln6\"" Jun 10 01:11:09.615615 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.615582 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86935439-8ca2-4f10-82dc-0e3117cd3552-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.615811 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.615632 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86935439-8ca2-4f10-82dc-0e3117cd3552-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.615811 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.615710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmh9\" (UniqueName: \"kubernetes.io/projected/86935439-8ca2-4f10-82dc-0e3117cd3552-kube-api-access-htmh9\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.615811 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.615741 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86935439-8ca2-4f10-82dc-0e3117cd3552-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.615811 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.615765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86935439-8ca2-4f10-82dc-0e3117cd3552-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.664483 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.664448 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn"] Jun 10 01:11:09.716483 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.716420 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86935439-8ca2-4f10-82dc-0e3117cd3552-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.716483 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.716484 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86935439-8ca2-4f10-82dc-0e3117cd3552-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.716697 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.716531 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htmh9\" (UniqueName: \"kubernetes.io/projected/86935439-8ca2-4f10-82dc-0e3117cd3552-kube-api-access-htmh9\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.716697 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.716552 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86935439-8ca2-4f10-82dc-0e3117cd3552-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.716697 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.716567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86935439-8ca2-4f10-82dc-0e3117cd3552-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.716982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.716957 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/86935439-8ca2-4f10-82dc-0e3117cd3552-manifests\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.718708 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.718677 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86935439-8ca2-4f10-82dc-0e3117cd3552-tmp\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.719159 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.719135 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86935439-8ca2-4f10-82dc-0e3117cd3552-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.719241 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.719135 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/86935439-8ca2-4f10-82dc-0e3117cd3552-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.724996 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.724960 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmh9\" (UniqueName: \"kubernetes.io/projected/86935439-8ca2-4f10-82dc-0e3117cd3552-kube-api-access-htmh9\") pod \"opendatahub-operator-controller-manager-7f47d5f68-s5ffn\" (UID: \"86935439-8ca2-4f10-82dc-0e3117cd3552\") " pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:09.879237 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:09.879142 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:10.029700 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:10.029668 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn"] Jun 10 01:11:10.032800 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:11:10.032769 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86935439_8ca2_4f10_82dc_0e3117cd3552.slice/crio-0c6986e50a9922002582a4b43fcba49be40421da965d01b02e69dc2e8daaab52 WatchSource:0}: Error finding container 0c6986e50a9922002582a4b43fcba49be40421da965d01b02e69dc2e8daaab52: Status 404 returned error can't find the container with id 0c6986e50a9922002582a4b43fcba49be40421da965d01b02e69dc2e8daaab52 Jun 10 01:11:10.034579 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:10.034560 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:11:10.668848 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:10.668806 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" event={"ID":"86935439-8ca2-4f10-82dc-0e3117cd3552","Type":"ContainerStarted","Data":"0c6986e50a9922002582a4b43fcba49be40421da965d01b02e69dc2e8daaab52"} Jun 10 01:11:13.684903 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:13.684867 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" event={"ID":"86935439-8ca2-4f10-82dc-0e3117cd3552","Type":"ContainerStarted","Data":"9447547628c0b9cc7b9a73c049aefe524c01da3b3118e13627698e2802f607d1"} Jun 10 01:11:14.690015 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:14.689979 2554 generic.go:356] "Generic (PLEG): container finished" podID="86935439-8ca2-4f10-82dc-0e3117cd3552" containerID="9447547628c0b9cc7b9a73c049aefe524c01da3b3118e13627698e2802f607d1" exitCode=0 Jun 10 01:11:14.690414 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:14.690057 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" event={"ID":"86935439-8ca2-4f10-82dc-0e3117cd3552","Type":"ContainerDied","Data":"9447547628c0b9cc7b9a73c049aefe524c01da3b3118e13627698e2802f607d1"} Jun 10 01:11:15.696114 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:15.696058 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" event={"ID":"86935439-8ca2-4f10-82dc-0e3117cd3552","Type":"ContainerStarted","Data":"64a68e9cf4d98bdf0c6b41b31673cddd6a610cd626e2944b1817ca16d0591427"} Jun 10 01:11:15.696635 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:15.696173 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:15.724667 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:15.724608 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" podStartSLOduration=2.696746728 podStartE2EDuration="6.724591686s" totalImagesPullingTime="3.080641579s" totalInitContainerRuntime="947.203379ms" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:15.722290057 +0000 UTC m=+550.447892393" watchObservedRunningTime="2026-06-10 01:11:15.724591686 +0000 UTC m=+550.450194044" Jun 10 01:11:26.701705 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:26.701673 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f47d5f68-s5ffn" Jun 10 01:11:27.318531 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.318495 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz"] Jun 10 01:11:27.323982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.323956 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.326336 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.326302 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 01:11:27.327238 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.327214 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 01:11:27.327666 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.327648 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6vz5v\"" Jun 10 01:11:27.327826 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.327803 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 01:11:27.327895 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.327749 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 01:11:27.329241 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.327681 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 01:11:27.332144 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.332119 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz"] Jun 10 01:11:27.357891 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.357856 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/748beac8-2722-42ab-be7c-b8a23ec50eb6-manager-config\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.357891 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.357902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/748beac8-2722-42ab-be7c-b8a23ec50eb6-cert\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.358135 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.357922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqclx\" (UniqueName: \"kubernetes.io/projected/748beac8-2722-42ab-be7c-b8a23ec50eb6-kube-api-access-qqclx\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.358135 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.358006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/748beac8-2722-42ab-be7c-b8a23ec50eb6-metrics-cert\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.458828 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.458785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/748beac8-2722-42ab-be7c-b8a23ec50eb6-manager-config\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.458828 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.458836 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/748beac8-2722-42ab-be7c-b8a23ec50eb6-cert\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.459047 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.458861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqclx\" (UniqueName: \"kubernetes.io/projected/748beac8-2722-42ab-be7c-b8a23ec50eb6-kube-api-access-qqclx\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.459047 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.458889 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/748beac8-2722-42ab-be7c-b8a23ec50eb6-metrics-cert\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.459524 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.459497 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/748beac8-2722-42ab-be7c-b8a23ec50eb6-manager-config\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.461420 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.461396 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/748beac8-2722-42ab-be7c-b8a23ec50eb6-cert\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.461516 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.461485 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/748beac8-2722-42ab-be7c-b8a23ec50eb6-metrics-cert\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.476057 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.476021 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqclx\" (UniqueName: \"kubernetes.io/projected/748beac8-2722-42ab-be7c-b8a23ec50eb6-kube-api-access-qqclx\") pod \"lws-controller-manager-67d5b6d8d5-5tmqz\" (UID: \"748beac8-2722-42ab-be7c-b8a23ec50eb6\") " pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.638390 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.638351 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:27.791474 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:27.791446 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz"] Jun 10 01:11:27.794116 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:11:27.794068 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748beac8_2722_42ab_be7c_b8a23ec50eb6.slice/crio-01a5e704dd73ee94c89490ae09b182ddca6e41ac50c4669b99b6123b8eff52b6 WatchSource:0}: Error finding container 01a5e704dd73ee94c89490ae09b182ddca6e41ac50c4669b99b6123b8eff52b6: Status 404 returned error can't find the container with id 01a5e704dd73ee94c89490ae09b182ddca6e41ac50c4669b99b6123b8eff52b6 Jun 10 01:11:28.747250 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:28.747208 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" event={"ID":"748beac8-2722-42ab-be7c-b8a23ec50eb6","Type":"ContainerStarted","Data":"01a5e704dd73ee94c89490ae09b182ddca6e41ac50c4669b99b6123b8eff52b6"} Jun 10 01:11:38.785878 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:38.785831 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" event={"ID":"748beac8-2722-42ab-be7c-b8a23ec50eb6","Type":"ContainerStarted","Data":"490f91048deb12a090a1b2f98f64ec71f02a3218ee31eb581018e3e7844fdd1d"} Jun 10 01:11:38.786327 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:38.785966 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:11:38.808652 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:38.808602 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" podStartSLOduration=1.7997048599999999 podStartE2EDuration="11.808587878s" totalImagesPullingTime="10.008883018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:11:38.807591093 +0000 UTC m=+573.533193446" watchObservedRunningTime="2026-06-10 01:11:38.808587878 +0000 UTC m=+573.534190195" Jun 10 01:11:49.792295 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:11:49.792260 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67d5b6d8d5-5tmqz" Jun 10 01:12:04.717397 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.717363 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-c8c9c9665-z7sfr"] Jun 10 01:12:04.720689 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.720667 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:04.723093 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.723058 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lfr5s\"" Jun 10 01:12:04.723219 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.723057 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 01:12:04.730558 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.730534 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-c8c9c9665-z7sfr"] Jun 10 01:12:04.778285 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.778248 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h9m4\" (UniqueName: \"kubernetes.io/projected/1deafc60-b757-4fde-b94b-dae7ae79b004-kube-api-access-6h9m4\") pod \"dashboard-redirect-c8c9c9665-z7sfr\" (UID: \"1deafc60-b757-4fde-b94b-dae7ae79b004\") " pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:04.778462 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.778324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1deafc60-b757-4fde-b94b-dae7ae79b004-redirect-config\") pod \"dashboard-redirect-c8c9c9665-z7sfr\" (UID: \"1deafc60-b757-4fde-b94b-dae7ae79b004\") " pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:04.879470 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.879434 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h9m4\" (UniqueName: \"kubernetes.io/projected/1deafc60-b757-4fde-b94b-dae7ae79b004-kube-api-access-6h9m4\") pod \"dashboard-redirect-c8c9c9665-z7sfr\" (UID: \"1deafc60-b757-4fde-b94b-dae7ae79b004\") " pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:04.879669 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.879516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1deafc60-b757-4fde-b94b-dae7ae79b004-redirect-config\") pod \"dashboard-redirect-c8c9c9665-z7sfr\" (UID: \"1deafc60-b757-4fde-b94b-dae7ae79b004\") " pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:04.880274 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.880256 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/1deafc60-b757-4fde-b94b-dae7ae79b004-redirect-config\") pod \"dashboard-redirect-c8c9c9665-z7sfr\" (UID: \"1deafc60-b757-4fde-b94b-dae7ae79b004\") " pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:04.890153 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:04.890121 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h9m4\" (UniqueName: \"kubernetes.io/projected/1deafc60-b757-4fde-b94b-dae7ae79b004-kube-api-access-6h9m4\") pod \"dashboard-redirect-c8c9c9665-z7sfr\" (UID: \"1deafc60-b757-4fde-b94b-dae7ae79b004\") " pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:05.032066 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.031975 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" Jun 10 01:12:05.168273 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.168241 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-c8c9c9665-z7sfr"] Jun 10 01:12:05.171466 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:12:05.171438 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1deafc60_b757_4fde_b94b_dae7ae79b004.slice/crio-e9adcbf372902ab526b85676bfcc8431a52b746963ae21494f311e29d212f440 WatchSource:0}: Error finding container e9adcbf372902ab526b85676bfcc8431a52b746963ae21494f311e29d212f440: Status 404 returned error can't find the container with id e9adcbf372902ab526b85676bfcc8431a52b746963ae21494f311e29d212f440 Jun 10 01:12:05.766164 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.766141 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:12:05.766577 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.766425 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:12:05.770800 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.770780 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:12:05.770957 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.770923 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:12:05.776632 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.776613 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:12:05.776898 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.776882 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:12:05.887284 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:05.887256 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" event={"ID":"1deafc60-b757-4fde-b94b-dae7ae79b004","Type":"ContainerStarted","Data":"e9adcbf372902ab526b85676bfcc8431a52b746963ae21494f311e29d212f440"} Jun 10 01:12:07.897946 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:07.897910 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" event={"ID":"1deafc60-b757-4fde-b94b-dae7ae79b004","Type":"ContainerStarted","Data":"853118acb1be684cdbc0f556a15d931213b10b0e312ecf7f4dd2491d16b74ed9"} Jun 10 01:12:07.914320 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:07.914270 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-c8c9c9665-z7sfr" podStartSLOduration=1.5945341499999999 podStartE2EDuration="3.914253883s" totalImagesPullingTime="2.319719733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:07.912487918 +0000 UTC m=+602.638090236" watchObservedRunningTime="2026-06-10 01:12:07.914253883 +0000 UTC m=+602.639856200" Jun 10 01:12:23.792543 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.792461 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv"] Jun 10 01:12:23.794484 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.794469 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.797171 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.797144 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 01:12:23.797171 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.797165 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-g9m6g\"" Jun 10 01:12:23.808699 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.808670 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv"] Jun 10 01:12:23.835897 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.835858 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836063 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.835900 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tckx\" (UniqueName: \"kubernetes.io/projected/87b53f92-64ef-4ecd-9f04-c9b348704f0a-kube-api-access-7tckx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836063 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.835934 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836063 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.835960 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836063 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.835982 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836217 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.836068 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836217 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.836131 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836217 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.836162 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.836217 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.836187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.936785 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.936743 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.936945 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.936816 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.936945 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.936861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.936945 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.936923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.936948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tckx\" (UniqueName: \"kubernetes.io/projected/87b53f92-64ef-4ecd-9f04-c9b348704f0a-kube-api-access-7tckx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.936980 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937012 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937045 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937443 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937225 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937443 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937303 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937616 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.937705 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.937682 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.938136 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.938113 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.939199 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.939177 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.939583 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.939559 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.946382 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.946356 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/87b53f92-64ef-4ecd-9f04-c9b348704f0a-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:23.946993 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:23.946971 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tckx\" (UniqueName: \"kubernetes.io/projected/87b53f92-64ef-4ecd-9f04-c9b348704f0a-kube-api-access-7tckx\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcxn9sv\" (UID: \"87b53f92-64ef-4ecd-9f04-c9b348704f0a\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:24.105519 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:24.105423 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:24.243303 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:24.243277 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv"] Jun 10 01:12:24.245659 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:12:24.245631 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87b53f92_64ef_4ecd_9f04_c9b348704f0a.slice/crio-a49d43d4428d763570325bb62c9ca4adcbb12f55c2f184942cb3ef6cbe071011 WatchSource:0}: Error finding container a49d43d4428d763570325bb62c9ca4adcbb12f55c2f184942cb3ef6cbe071011: Status 404 returned error can't find the container with id a49d43d4428d763570325bb62c9ca4adcbb12f55c2f184942cb3ef6cbe071011 Jun 10 01:12:24.963038 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:24.963003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" event={"ID":"87b53f92-64ef-4ecd-9f04-c9b348704f0a","Type":"ContainerStarted","Data":"a49d43d4428d763570325bb62c9ca4adcbb12f55c2f184942cb3ef6cbe071011"} Jun 10 01:12:27.844577 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:27.844524 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:12:27.844863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:27.844609 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:12:27.844863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:27.844638 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:12:27.978173 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:27.978138 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" event={"ID":"87b53f92-64ef-4ecd-9f04-c9b348704f0a","Type":"ContainerStarted","Data":"de0395cda1d72d3ec055be098813a39802035a9136f0b3c295bdd7f3d2ebad54"} Jun 10 01:12:27.997214 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:27.997156 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" podStartSLOduration=1.402839913 podStartE2EDuration="4.997138812s" totalImagesPullingTime="3.594298899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:27.995532215 +0000 UTC m=+622.721134534" watchObservedRunningTime="2026-06-10 01:12:27.997138812 +0000 UTC m=+622.722741128" Jun 10 01:12:28.106180 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:28.106089 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:28.107574 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:28.107540 2554 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jun 10 01:12:28.107705 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:28.107598 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" podUID="87b53f92-64ef-4ecd-9f04-c9b348704f0a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jun 10 01:12:29.109348 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:29.109319 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:29.986736 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:29.986702 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:29.987830 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:29.987807 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcxn9sv" Jun 10 01:12:30.174456 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.174416 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-njjs4"] Jun 10 01:12:30.176801 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.176778 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:30.179115 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.179065 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 01:12:30.179243 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.179173 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-wxwzt\"" Jun 10 01:12:30.179243 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.179183 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 01:12:30.185743 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.185720 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-njjs4"] Jun 10 01:12:30.297054 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.296964 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hm8q\" (UniqueName: \"kubernetes.io/projected/000fec5e-1a8c-4986-b686-20d874ee56c7-kube-api-access-2hm8q\") pod \"kuadrant-operator-catalog-njjs4\" (UID: \"000fec5e-1a8c-4986-b686-20d874ee56c7\") " pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:30.398359 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.398321 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hm8q\" (UniqueName: \"kubernetes.io/projected/000fec5e-1a8c-4986-b686-20d874ee56c7-kube-api-access-2hm8q\") pod \"kuadrant-operator-catalog-njjs4\" (UID: \"000fec5e-1a8c-4986-b686-20d874ee56c7\") " pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:30.406703 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.406675 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hm8q\" (UniqueName: \"kubernetes.io/projected/000fec5e-1a8c-4986-b686-20d874ee56c7-kube-api-access-2hm8q\") pod \"kuadrant-operator-catalog-njjs4\" (UID: \"000fec5e-1a8c-4986-b686-20d874ee56c7\") " pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:30.487751 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.487710 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:30.540820 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.540791 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-njjs4"] Jun 10 01:12:30.619218 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.619194 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-njjs4"] Jun 10 01:12:30.621804 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:12:30.621776 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod000fec5e_1a8c_4986_b686_20d874ee56c7.slice/crio-a8e4aada3a74988b9a1b3d76ca8f9ebd09494b7e52fca0505687db75638734c0 WatchSource:0}: Error finding container a8e4aada3a74988b9a1b3d76ca8f9ebd09494b7e52fca0505687db75638734c0: Status 404 returned error can't find the container with id a8e4aada3a74988b9a1b3d76ca8f9ebd09494b7e52fca0505687db75638734c0 Jun 10 01:12:30.750118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.750084 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4wmnd"] Jun 10 01:12:30.752580 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.752564 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:30.760586 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.760563 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4wmnd"] Jun 10 01:12:30.902005 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.901971 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2xjl\" (UniqueName: \"kubernetes.io/projected/1d912d12-8303-4077-8d32-5c9e559bac69-kube-api-access-d2xjl\") pod \"kuadrant-operator-catalog-4wmnd\" (UID: \"1d912d12-8303-4077-8d32-5c9e559bac69\") " pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:30.992426 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:30.992388 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" event={"ID":"000fec5e-1a8c-4986-b686-20d874ee56c7","Type":"ContainerStarted","Data":"a8e4aada3a74988b9a1b3d76ca8f9ebd09494b7e52fca0505687db75638734c0"} Jun 10 01:12:31.003096 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:31.003051 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2xjl\" (UniqueName: \"kubernetes.io/projected/1d912d12-8303-4077-8d32-5c9e559bac69-kube-api-access-d2xjl\") pod \"kuadrant-operator-catalog-4wmnd\" (UID: \"1d912d12-8303-4077-8d32-5c9e559bac69\") " pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:31.012710 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:31.012685 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2xjl\" (UniqueName: \"kubernetes.io/projected/1d912d12-8303-4077-8d32-5c9e559bac69-kube-api-access-d2xjl\") pod \"kuadrant-operator-catalog-4wmnd\" (UID: \"1d912d12-8303-4077-8d32-5c9e559bac69\") " pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:31.062820 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:31.062779 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:31.207049 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:31.207013 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4wmnd"] Jun 10 01:12:31.210070 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:12:31.210031 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d912d12_8303_4077_8d32_5c9e559bac69.slice/crio-92fb4d50c31fe85617e078b5be1d74fa95f9872659a48f0d6f083003fcd166fa WatchSource:0}: Error finding container 92fb4d50c31fe85617e078b5be1d74fa95f9872659a48f0d6f083003fcd166fa: Status 404 returned error can't find the container with id 92fb4d50c31fe85617e078b5be1d74fa95f9872659a48f0d6f083003fcd166fa Jun 10 01:12:31.999128 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:31.999061 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" event={"ID":"1d912d12-8303-4077-8d32-5c9e559bac69","Type":"ContainerStarted","Data":"92fb4d50c31fe85617e078b5be1d74fa95f9872659a48f0d6f083003fcd166fa"} Jun 10 01:12:33.004738 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.004696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" event={"ID":"000fec5e-1a8c-4986-b686-20d874ee56c7","Type":"ContainerStarted","Data":"53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad"} Jun 10 01:12:33.005247 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.004740 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" podUID="000fec5e-1a8c-4986-b686-20d874ee56c7" containerName="registry-server" containerID="cri-o://53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad" gracePeriod=2 Jun 10 01:12:33.006447 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.006417 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" event={"ID":"1d912d12-8303-4077-8d32-5c9e559bac69","Type":"ContainerStarted","Data":"24b9994b7a01a7d5151e315ac460dc0429118f991117a19f5bfdc7fedcfacd5e"} Jun 10 01:12:33.020061 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.020019 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" podStartSLOduration=1.043186722 podStartE2EDuration="3.020005559s" totalImagesPullingTime="1.976818837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:33.018955669 +0000 UTC m=+627.744558014" watchObservedRunningTime="2026-06-10 01:12:33.020005559 +0000 UTC m=+627.745607876" Jun 10 01:12:33.034361 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.034308 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" podStartSLOduration=1.644890965 podStartE2EDuration="3.034290528s" totalImagesPullingTime="1.389399563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:12:33.032869905 +0000 UTC m=+627.758472215" watchObservedRunningTime="2026-06-10 01:12:33.034290528 +0000 UTC m=+627.759892846" Jun 10 01:12:33.253063 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.253036 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:33.324991 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.324910 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hm8q\" (UniqueName: \"kubernetes.io/projected/000fec5e-1a8c-4986-b686-20d874ee56c7-kube-api-access-2hm8q\") pod \"000fec5e-1a8c-4986-b686-20d874ee56c7\" (UID: \"000fec5e-1a8c-4986-b686-20d874ee56c7\") " Jun 10 01:12:33.326877 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.326847 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/000fec5e-1a8c-4986-b686-20d874ee56c7-kube-api-access-2hm8q" (OuterVolumeSpecName: "kube-api-access-2hm8q") pod "000fec5e-1a8c-4986-b686-20d874ee56c7" (UID: "000fec5e-1a8c-4986-b686-20d874ee56c7"). InnerVolumeSpecName "kube-api-access-2hm8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:12:33.426450 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:33.426413 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hm8q\" (UniqueName: \"kubernetes.io/projected/000fec5e-1a8c-4986-b686-20d874ee56c7-kube-api-access-2hm8q\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:12:34.012173 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.012139 2554 generic.go:356] "Generic (PLEG): container finished" podID="000fec5e-1a8c-4986-b686-20d874ee56c7" containerID="53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad" exitCode=0 Jun 10 01:12:34.012173 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.012177 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" Jun 10 01:12:34.012642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.012221 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" event={"ID":"000fec5e-1a8c-4986-b686-20d874ee56c7","Type":"ContainerDied","Data":"53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad"} Jun 10 01:12:34.012642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.012273 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-njjs4" event={"ID":"000fec5e-1a8c-4986-b686-20d874ee56c7","Type":"ContainerDied","Data":"a8e4aada3a74988b9a1b3d76ca8f9ebd09494b7e52fca0505687db75638734c0"} Jun 10 01:12:34.012642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.012300 2554 scope.go:117] "RemoveContainer" containerID="53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad" Jun 10 01:12:34.020860 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.020837 2554 scope.go:117] "RemoveContainer" containerID="53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad" Jun 10 01:12:34.021125 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:12:34.021102 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad\": container with ID starting with 53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad not found: ID does not exist" containerID="53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad" Jun 10 01:12:34.021194 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.021137 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad"} err="failed to get container status \"53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad\": rpc error: code = NotFound desc = could not find container \"53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad\": container with ID starting with 53bfcbc1d926f8da79b082edb07954975a97698436209b21446ce3b438be67ad not found: ID does not exist" Jun 10 01:12:34.040292 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.040260 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-njjs4"] Jun 10 01:12:34.043497 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:34.043473 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-njjs4"] Jun 10 01:12:35.816752 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:35.816719 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="000fec5e-1a8c-4986-b686-20d874ee56c7" path="/var/lib/kubelet/pods/000fec5e-1a8c-4986-b686-20d874ee56c7/volumes" Jun 10 01:12:41.063851 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:41.063811 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:41.064317 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:41.063879 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:41.085940 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:41.085911 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:12:42.069686 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:12:42.069653 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4wmnd" Jun 10 01:13:02.852128 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.852096 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs"] Jun 10 01:13:02.852530 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.852389 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="000fec5e-1a8c-4986-b686-20d874ee56c7" containerName="registry-server" Jun 10 01:13:02.852530 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.852399 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="000fec5e-1a8c-4986-b686-20d874ee56c7" containerName="registry-server" Jun 10 01:13:02.852530 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.852484 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="000fec5e-1a8c-4986-b686-20d874ee56c7" containerName="registry-server" Jun 10 01:13:02.860207 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.860185 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:02.862609 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.862585 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6w6kl\"" Jun 10 01:13:02.865754 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.865733 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs"] Jun 10 01:13:02.980382 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:02.980339 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg5gm\" (UniqueName: \"kubernetes.io/projected/50eb9c0c-7924-4bd7-9993-08ffbeae7b63-kube-api-access-vg5gm\") pod \"authorino-operator-75cc8d5cb7-fdzhs\" (UID: \"50eb9c0c-7924-4bd7-9993-08ffbeae7b63\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:03.081412 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:03.081371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg5gm\" (UniqueName: \"kubernetes.io/projected/50eb9c0c-7924-4bd7-9993-08ffbeae7b63-kube-api-access-vg5gm\") pod \"authorino-operator-75cc8d5cb7-fdzhs\" (UID: \"50eb9c0c-7924-4bd7-9993-08ffbeae7b63\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:03.094351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:03.094317 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg5gm\" (UniqueName: \"kubernetes.io/projected/50eb9c0c-7924-4bd7-9993-08ffbeae7b63-kube-api-access-vg5gm\") pod \"authorino-operator-75cc8d5cb7-fdzhs\" (UID: \"50eb9c0c-7924-4bd7-9993-08ffbeae7b63\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:03.171562 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:03.171531 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:03.301454 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:03.301424 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs"] Jun 10 01:13:03.304026 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:13:03.303997 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50eb9c0c_7924_4bd7_9993_08ffbeae7b63.slice/crio-971c12b3ddb46d75447963ef8d46fc18d1188f54c6686af985a292b890ca9d78 WatchSource:0}: Error finding container 971c12b3ddb46d75447963ef8d46fc18d1188f54c6686af985a292b890ca9d78: Status 404 returned error can't find the container with id 971c12b3ddb46d75447963ef8d46fc18d1188f54c6686af985a292b890ca9d78 Jun 10 01:13:04.138989 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:04.138934 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" event={"ID":"50eb9c0c-7924-4bd7-9993-08ffbeae7b63","Type":"ContainerStarted","Data":"971c12b3ddb46d75447963ef8d46fc18d1188f54c6686af985a292b890ca9d78"} Jun 10 01:13:06.150041 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:06.150003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" event={"ID":"50eb9c0c-7924-4bd7-9993-08ffbeae7b63","Type":"ContainerStarted","Data":"d4971cabfa2ac70c174ea6a190cc171664e48a095a808bb2c3303b73ff92b745"} Jun 10 01:13:06.150466 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:06.150116 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:06.194146 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:06.194064 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" podStartSLOduration=1.6304089309999998 podStartE2EDuration="4.194048061s" totalImagesPullingTime="2.56363913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:06.193220909 +0000 UTC m=+660.918823252" watchObservedRunningTime="2026-06-10 01:13:06.194048061 +0000 UTC m=+660.919650450" Jun 10 01:13:07.560139 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.560096 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk"] Jun 10 01:13:07.564514 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.564493 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.566737 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.566710 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kb6jf\"" Jun 10 01:13:07.576042 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.576019 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk"] Jun 10 01:13:07.629522 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.629478 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592k7\" (UniqueName: \"kubernetes.io/projected/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-kube-api-access-592k7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.629753 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.629528 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.730463 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.730423 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592k7\" (UniqueName: \"kubernetes.io/projected/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-kube-api-access-592k7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.730463 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.730465 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.730857 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.730836 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.742696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.742663 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592k7\" (UniqueName: \"kubernetes.io/projected/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-kube-api-access-592k7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:07.874645 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:07.874546 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:08.006601 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:08.006479 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk"] Jun 10 01:13:08.008915 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:13:08.008883 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7970d6f3_6ede_45a4_bcf4_0fc3b167273e.slice/crio-906c668046e90b0a72c9e166bcee8ae5ddf9101091d58d5552236496263113dd WatchSource:0}: Error finding container 906c668046e90b0a72c9e166bcee8ae5ddf9101091d58d5552236496263113dd: Status 404 returned error can't find the container with id 906c668046e90b0a72c9e166bcee8ae5ddf9101091d58d5552236496263113dd Jun 10 01:13:08.159642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:08.159605 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" event={"ID":"7970d6f3-6ede-45a4-bcf4-0fc3b167273e","Type":"ContainerStarted","Data":"906c668046e90b0a72c9e166bcee8ae5ddf9101091d58d5552236496263113dd"} Jun 10 01:13:15.192475 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:15.192434 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" event={"ID":"7970d6f3-6ede-45a4-bcf4-0fc3b167273e","Type":"ContainerStarted","Data":"8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338"} Jun 10 01:13:15.192863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:15.192545 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:15.222768 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:15.222716 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" podStartSLOduration=1.7196772820000001 podStartE2EDuration="8.222700489s" totalImagesPullingTime="6.503023207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:15.220952089 +0000 UTC m=+669.946554417" watchObservedRunningTime="2026-06-10 01:13:15.222700489 +0000 UTC m=+669.948302795" Jun 10 01:13:17.156843 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:17.156810 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-fdzhs" Jun 10 01:13:26.199671 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:26.199635 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:27.827412 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.827373 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk"] Jun 10 01:13:27.827821 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.827555 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" containerName="manager" containerID="cri-o://8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338" gracePeriod=2 Jun 10 01:13:27.840502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.840473 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk"] Jun 10 01:13:27.841286 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:27.841247 2554 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\": pods \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:27.855056 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.855029 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f"] Jun 10 01:13:27.855429 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.855412 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" containerName="manager" Jun 10 01:13:27.855524 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.855432 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" containerName="manager" Jun 10 01:13:27.855524 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.855503 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" containerName="manager" Jun 10 01:13:27.858317 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.858298 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:27.860269 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:27.860239 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" is forbidden: User \"system:node:ip-10-0-142-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-1.ec2.internal' and this object" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:27.872133 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:27.872105 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f"] Jun 10 01:13:28.012682 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.012648 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4482e27b-a535-4356-bd93-53cafa02fa7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7xn7f\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.012874 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.012694 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vcv8\" (UniqueName: \"kubernetes.io/projected/4482e27b-a535-4356-bd93-53cafa02fa7c-kube-api-access-5vcv8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7xn7f\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.066868 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.066844 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:28.068789 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:28.068763 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" is forbidden: User \"system:node:ip-10-0-142-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-1.ec2.internal' and this object" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:28.113203 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.113111 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vcv8\" (UniqueName: \"kubernetes.io/projected/4482e27b-a535-4356-bd93-53cafa02fa7c-kube-api-access-5vcv8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7xn7f\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.113338 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.113221 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4482e27b-a535-4356-bd93-53cafa02fa7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7xn7f\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.113548 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.113529 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4482e27b-a535-4356-bd93-53cafa02fa7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7xn7f\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.123497 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.123465 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vcv8\" (UniqueName: \"kubernetes.io/projected/4482e27b-a535-4356-bd93-53cafa02fa7c-kube-api-access-5vcv8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7xn7f\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.213969 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.213935 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592k7\" (UniqueName: \"kubernetes.io/projected/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-kube-api-access-592k7\") pod \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " Jun 10 01:13:28.214157 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.214004 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-extensions-socket-volume\") pod \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\" (UID: \"7970d6f3-6ede-45a4-bcf4-0fc3b167273e\") " Jun 10 01:13:28.214475 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.214440 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7970d6f3-6ede-45a4-bcf4-0fc3b167273e" (UID: "7970d6f3-6ede-45a4-bcf4-0fc3b167273e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:13:28.214657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.214642 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:28.216035 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.216012 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-kube-api-access-592k7" (OuterVolumeSpecName: "kube-api-access-592k7") pod "7970d6f3-6ede-45a4-bcf4-0fc3b167273e" (UID: "7970d6f3-6ede-45a4-bcf4-0fc3b167273e"). InnerVolumeSpecName "kube-api-access-592k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:28.250418 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.250385 2554 generic.go:356] "Generic (PLEG): container finished" podID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" containerID="8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338" exitCode=0 Jun 10 01:13:28.250598 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.250431 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:28.250598 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.250500 2554 scope.go:117] "RemoveContainer" containerID="8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338" Jun 10 01:13:28.252500 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:28.252460 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" is forbidden: User \"system:node:ip-10-0-142-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-1.ec2.internal' and this object" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:28.260527 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.260511 2554 scope.go:117] "RemoveContainer" containerID="8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338" Jun 10 01:13:28.260804 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:28.260787 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338\": container with ID starting with 8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338 not found: ID does not exist" containerID="8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338" Jun 10 01:13:28.260873 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.260814 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338"} err="failed to get container status \"8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338\": rpc error: code = NotFound desc = could not find container \"8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338\": container with ID starting with 8f90e7c5ca17aae98ac403d441be5febf669749588361cd7baa6f16ec11ec338 not found: ID does not exist" Jun 10 01:13:28.261803 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:28.261778 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" is forbidden: User \"system:node:ip-10-0-142-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-1.ec2.internal' and this object" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:28.314982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.314945 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-extensions-socket-volume\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:13:28.314982 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.314981 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592k7\" (UniqueName: \"kubernetes.io/projected/7970d6f3-6ede-45a4-bcf4-0fc3b167273e-kube-api-access-592k7\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:13:28.349109 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:28.349058 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f"] Jun 10 01:13:28.352115 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:13:28.352070 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4482e27b_a535_4356_bd93_53cafa02fa7c.slice/crio-1443539cdcfb4e7ed011a2dfb85ba357560cf75937295ab96275127804e4da56 WatchSource:0}: Error finding container 1443539cdcfb4e7ed011a2dfb85ba357560cf75937295ab96275127804e4da56: Status 404 returned error can't find the container with id 1443539cdcfb4e7ed011a2dfb85ba357560cf75937295ab96275127804e4da56 Jun 10 01:13:29.262377 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:29.262339 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" event={"ID":"4482e27b-a535-4356-bd93-53cafa02fa7c","Type":"ContainerStarted","Data":"c8cd1ea96b62d2c326e29e8957f37eea8fb08b86e36bf4f4f4752f4571a29048"} Jun 10 01:13:29.262865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:29.262414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" event={"ID":"4482e27b-a535-4356-bd93-53cafa02fa7c","Type":"ContainerStarted","Data":"1443539cdcfb4e7ed011a2dfb85ba357560cf75937295ab96275127804e4da56"} Jun 10 01:13:29.262865 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:29.262450 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:29.287056 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:29.287000 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" podStartSLOduration=2.286984702 podStartE2EDuration="2.286984702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:13:29.286711514 +0000 UTC m=+684.012313864" watchObservedRunningTime="2026-06-10 01:13:29.286984702 +0000 UTC m=+684.012587019" Jun 10 01:13:29.288639 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:13:29.288615 2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-wd7dk\" is forbidden: User \"system:node:ip-10-0-142-1.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-1.ec2.internal' and this object" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wd7dk" Jun 10 01:13:29.816626 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:29.816583 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7970d6f3-6ede-45a4-bcf4-0fc3b167273e" path="/var/lib/kubelet/pods/7970d6f3-6ede-45a4-bcf4-0fc3b167273e/volumes" Jun 10 01:13:40.269107 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:40.269062 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:59.238588 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.238550 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f"] Jun 10 01:13:59.239050 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.238752 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" podUID="4482e27b-a535-4356-bd93-53cafa02fa7c" containerName="manager" containerID="cri-o://c8cd1ea96b62d2c326e29e8957f37eea8fb08b86e36bf4f4f4752f4571a29048" gracePeriod=10 Jun 10 01:13:59.397540 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.397509 2554 generic.go:356] "Generic (PLEG): container finished" podID="4482e27b-a535-4356-bd93-53cafa02fa7c" containerID="c8cd1ea96b62d2c326e29e8957f37eea8fb08b86e36bf4f4f4752f4571a29048" exitCode=0 Jun 10 01:13:59.397715 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.397566 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" event={"ID":"4482e27b-a535-4356-bd93-53cafa02fa7c","Type":"ContainerDied","Data":"c8cd1ea96b62d2c326e29e8957f37eea8fb08b86e36bf4f4f4752f4571a29048"} Jun 10 01:13:59.447670 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.447637 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf"] Jun 10 01:13:59.450885 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.450864 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.471091 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.471055 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf"] Jun 10 01:13:59.496238 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.496187 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:13:59.580086 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.580039 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vcv8\" (UniqueName: \"kubernetes.io/projected/4482e27b-a535-4356-bd93-53cafa02fa7c-kube-api-access-5vcv8\") pod \"4482e27b-a535-4356-bd93-53cafa02fa7c\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " Jun 10 01:13:59.580247 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.580149 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4482e27b-a535-4356-bd93-53cafa02fa7c-extensions-socket-volume\") pod \"4482e27b-a535-4356-bd93-53cafa02fa7c\" (UID: \"4482e27b-a535-4356-bd93-53cafa02fa7c\") " Jun 10 01:13:59.580328 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.580306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kfpkf\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.580364 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.580349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2x66\" (UniqueName: \"kubernetes.io/projected/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-kube-api-access-c2x66\") pod \"kuadrant-operator-controller-manager-86878c769f-kfpkf\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.580554 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.580520 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4482e27b-a535-4356-bd93-53cafa02fa7c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4482e27b-a535-4356-bd93-53cafa02fa7c" (UID: "4482e27b-a535-4356-bd93-53cafa02fa7c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:13:59.582238 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.582216 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4482e27b-a535-4356-bd93-53cafa02fa7c-kube-api-access-5vcv8" (OuterVolumeSpecName: "kube-api-access-5vcv8") pod "4482e27b-a535-4356-bd93-53cafa02fa7c" (UID: "4482e27b-a535-4356-bd93-53cafa02fa7c"). InnerVolumeSpecName "kube-api-access-5vcv8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:13:59.680875 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.680820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kfpkf\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.680875 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.680876 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2x66\" (UniqueName: \"kubernetes.io/projected/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-kube-api-access-c2x66\") pod \"kuadrant-operator-controller-manager-86878c769f-kfpkf\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.681139 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.680975 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vcv8\" (UniqueName: \"kubernetes.io/projected/4482e27b-a535-4356-bd93-53cafa02fa7c-kube-api-access-5vcv8\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:13:59.681139 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.680991 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4482e27b-a535-4356-bd93-53cafa02fa7c-extensions-socket-volume\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:13:59.681240 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.681218 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-kfpkf\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.688523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.688501 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2x66\" (UniqueName: \"kubernetes.io/projected/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-kube-api-access-c2x66\") pod \"kuadrant-operator-controller-manager-86878c769f-kfpkf\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.761573 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.761480 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:13:59.891202 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:13:59.891171 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf"] Jun 10 01:13:59.894410 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:13:59.894386 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0656ac6_b282_4c44_ac8e_f1bbc18e2cf2.slice/crio-c3125b0ebe8e63b481d90f9865d611c0e777e0b07843084d705a7b6d6184313e WatchSource:0}: Error finding container c3125b0ebe8e63b481d90f9865d611c0e777e0b07843084d705a7b6d6184313e: Status 404 returned error can't find the container with id c3125b0ebe8e63b481d90f9865d611c0e777e0b07843084d705a7b6d6184313e Jun 10 01:14:00.403581 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.403543 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" event={"ID":"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2","Type":"ContainerStarted","Data":"28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03"} Jun 10 01:14:00.404014 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.403611 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:14:00.404014 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.403639 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" event={"ID":"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2","Type":"ContainerStarted","Data":"c3125b0ebe8e63b481d90f9865d611c0e777e0b07843084d705a7b6d6184313e"} Jun 10 01:14:00.404930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.404908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" event={"ID":"4482e27b-a535-4356-bd93-53cafa02fa7c","Type":"ContainerDied","Data":"1443539cdcfb4e7ed011a2dfb85ba357560cf75937295ab96275127804e4da56"} Jun 10 01:14:00.404988 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.404929 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f" Jun 10 01:14:00.404988 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.404960 2554 scope.go:117] "RemoveContainer" containerID="c8cd1ea96b62d2c326e29e8957f37eea8fb08b86e36bf4f4f4752f4571a29048" Jun 10 01:14:00.421699 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.421653 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" podStartSLOduration=1.421637335 podStartE2EDuration="1.421637335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:00.420388955 +0000 UTC m=+715.145991288" watchObservedRunningTime="2026-06-10 01:14:00.421637335 +0000 UTC m=+715.147239727" Jun 10 01:14:00.439806 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.439770 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f"] Jun 10 01:14:00.446431 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:00.446389 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7xn7f"] Jun 10 01:14:01.817132 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:01.817064 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4482e27b-a535-4356-bd93-53cafa02fa7c" path="/var/lib/kubelet/pods/4482e27b-a535-4356-bd93-53cafa02fa7c/volumes" Jun 10 01:14:11.412133 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:11.412102 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:14:15.490786 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.490753 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k"] Jun 10 01:14:15.491267 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.491247 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4482e27b-a535-4356-bd93-53cafa02fa7c" containerName="manager" Jun 10 01:14:15.491320 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.491271 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4482e27b-a535-4356-bd93-53cafa02fa7c" containerName="manager" Jun 10 01:14:15.491385 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.491373 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4482e27b-a535-4356-bd93-53cafa02fa7c" containerName="manager" Jun 10 01:14:15.496260 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.496236 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.498552 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.498528 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cd9qx\"" Jun 10 01:14:15.507659 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.507633 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k"] Jun 10 01:14:15.620775 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.620730 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.620959 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.620789 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.620959 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.620834 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.620959 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.620911 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.620959 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.620941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcrr4\" (UniqueName: \"kubernetes.io/projected/83b26584-3d46-409c-b13d-b46b9fe675dd-kube-api-access-bcrr4\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.621145 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.620990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.621145 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.621014 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b26584-3d46-409c-b13d-b46b9fe675dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.621145 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.621062 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.621145 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.621105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721741 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721700 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721741 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721742 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721765 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721804 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721842 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721875 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721902 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcrr4\" (UniqueName: \"kubernetes.io/projected/83b26584-3d46-409c-b13d-b46b9fe675dd-kube-api-access-bcrr4\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.721952 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721929 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.722267 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.721961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b26584-3d46-409c-b13d-b46b9fe675dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.722267 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.722160 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.722267 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.722192 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.722267 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.722258 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.722452 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.722431 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.722713 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.722692 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/83b26584-3d46-409c-b13d-b46b9fe675dd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.724010 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.723988 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.724405 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.724386 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.730536 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.730512 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/83b26584-3d46-409c-b13d-b46b9fe675dd-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.730731 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.730711 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcrr4\" (UniqueName: \"kubernetes.io/projected/83b26584-3d46-409c-b13d-b46b9fe675dd-kube-api-access-bcrr4\") pod \"maas-default-gateway-openshift-default-8559cd5744-n622k\" (UID: \"83b26584-3d46-409c-b13d-b46b9fe675dd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.807918 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.807835 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:15.945145 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.945095 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k"] Jun 10 01:14:15.947789 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:14:15.947764 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b26584_3d46_409c_b13d_b46b9fe675dd.slice/crio-4a23983bdeb05216fa97ab2d099857a90a3e96ae9b0a247030b892d524b81900 WatchSource:0}: Error finding container 4a23983bdeb05216fa97ab2d099857a90a3e96ae9b0a247030b892d524b81900: Status 404 returned error can't find the container with id 4a23983bdeb05216fa97ab2d099857a90a3e96ae9b0a247030b892d524b81900 Jun 10 01:14:15.949853 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.949807 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:14:15.949963 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.949879 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:14:15.949963 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:15.949908 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:14:16.474468 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:16.474430 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" event={"ID":"83b26584-3d46-409c-b13d-b46b9fe675dd","Type":"ContainerStarted","Data":"cf45043ec3995c66bcaa0e3555a056a2528b4f24df52d2df92c9ea8c1dae757f"} Jun 10 01:14:16.474671 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:16.474484 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" event={"ID":"83b26584-3d46-409c-b13d-b46b9fe675dd","Type":"ContainerStarted","Data":"4a23983bdeb05216fa97ab2d099857a90a3e96ae9b0a247030b892d524b81900"} Jun 10 01:14:16.495119 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:16.495044 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" podStartSLOduration=1.495029172 podStartE2EDuration="1.495029172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:16.49300107 +0000 UTC m=+731.218603412" watchObservedRunningTime="2026-06-10 01:14:16.495029172 +0000 UTC m=+731.220631489" Jun 10 01:14:16.808386 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:16.808285 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:17.817091 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:17.817059 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:18.484984 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:18.484953 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:18.486158 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:18.486132 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:14:20.320067 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.320030 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjbmm"] Jun 10 01:14:20.323413 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.323395 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:14:20.325529 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.325505 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9vbnj\"" Jun 10 01:14:20.329371 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.329351 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjbmm"] Jun 10 01:14:20.468182 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.468147 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n25p\" (UniqueName: \"kubernetes.io/projected/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a-kube-api-access-4n25p\") pod \"authorino-75d556bd77-wjbmm\" (UID: \"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a\") " pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:14:20.569560 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.569529 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n25p\" (UniqueName: \"kubernetes.io/projected/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a-kube-api-access-4n25p\") pod \"authorino-75d556bd77-wjbmm\" (UID: \"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a\") " pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:14:20.578110 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.578038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n25p\" (UniqueName: \"kubernetes.io/projected/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a-kube-api-access-4n25p\") pod \"authorino-75d556bd77-wjbmm\" (UID: \"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a\") " pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:14:20.634151 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.634122 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:14:20.758510 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:20.758476 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjbmm"] Jun 10 01:14:20.762918 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:14:20.762891 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48a4b3aa_a1d0_4abb_917b_c5e5ff087a3a.slice/crio-a3aa7b046d2274882dc8478266478f1a0b6b730b1af1d121bd417a881c671e1a WatchSource:0}: Error finding container a3aa7b046d2274882dc8478266478f1a0b6b730b1af1d121bd417a881c671e1a: Status 404 returned error can't find the container with id a3aa7b046d2274882dc8478266478f1a0b6b730b1af1d121bd417a881c671e1a Jun 10 01:14:21.499112 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:21.499051 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjbmm" event={"ID":"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a","Type":"ContainerStarted","Data":"a3aa7b046d2274882dc8478266478f1a0b6b730b1af1d121bd417a881c671e1a"} Jun 10 01:14:25.523873 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:25.523832 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjbmm" event={"ID":"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a","Type":"ContainerStarted","Data":"853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51"} Jun 10 01:14:25.539644 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:14:25.539596 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wjbmm" podStartSLOduration=1.5698942489999999 podStartE2EDuration="5.539580625s" totalImagesPullingTime="3.969686376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:14:25.538889387 +0000 UTC m=+740.264491705" watchObservedRunningTime="2026-06-10 01:14:25.539580625 +0000 UTC m=+740.265182941" Jun 10 01:15:14.469178 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.469145 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:15:14.475764 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.474784 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:14.477391 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.477362 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 01:15:14.477513 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.477471 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-4xffv\"" Jun 10 01:15:14.478174 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.478157 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 01:15:14.478238 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.478184 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 01:15:14.480770 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.480750 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:15:14.572522 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.572493 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/4929781a-0f0d-4513-b54d-b1359626c07b-kube-api-access-w5dgn\") pod \"maas-keycloak-0\" (UID: \"4929781a-0f0d-4513-b54d-b1359626c07b\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:14.673614 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.673560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/4929781a-0f0d-4513-b54d-b1359626c07b-kube-api-access-w5dgn\") pod \"maas-keycloak-0\" (UID: \"4929781a-0f0d-4513-b54d-b1359626c07b\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:14.681572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.681540 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/4929781a-0f0d-4513-b54d-b1359626c07b-kube-api-access-w5dgn\") pod \"maas-keycloak-0\" (UID: \"4929781a-0f0d-4513-b54d-b1359626c07b\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:14.786572 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.786486 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:14.916484 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:14.916458 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:15:14.919138 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:15:14.919108 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4929781a_0f0d_4513_b54d_b1359626c07b.slice/crio-f00dfeeb6da3427942094996318f7c174fde8999e757bcfaafc5b79602146856 WatchSource:0}: Error finding container f00dfeeb6da3427942094996318f7c174fde8999e757bcfaafc5b79602146856: Status 404 returned error can't find the container with id f00dfeeb6da3427942094996318f7c174fde8999e757bcfaafc5b79602146856 Jun 10 01:15:15.750368 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:15.750325 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4929781a-0f0d-4513-b54d-b1359626c07b","Type":"ContainerStarted","Data":"f00dfeeb6da3427942094996318f7c174fde8999e757bcfaafc5b79602146856"} Jun 10 01:15:20.775099 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:20.775041 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4929781a-0f0d-4513-b54d-b1359626c07b","Type":"ContainerStarted","Data":"99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a"} Jun 10 01:15:20.787277 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:20.787244 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:20.789248 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:20.789210 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:20.793179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:20.793116 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.936847771 podStartE2EDuration="6.793098075s" totalImagesPullingTime="4.856250304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:20.791457495 +0000 UTC m=+795.517059809" watchObservedRunningTime="2026-06-10 01:15:20.793098075 +0000 UTC m=+795.518700393" Jun 10 01:15:21.787599 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:21.787552 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:22.787092 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:22.787022 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:23.788016 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:23.787947 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:24.787222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:24.787180 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:24.787581 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:24.787539 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:25.787998 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:25.787951 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:26.787577 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:26.787522 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:27.787741 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:27.787684 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:28.787871 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:28.787823 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:29.787764 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:29.787719 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:30.787534 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:30.787482 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:31.787846 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:31.787791 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:32.786927 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:32.786880 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 10 01:15:33.914124 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:33.914059 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:33.934592 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:33.934311 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:15:43.921910 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:43.921877 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:15:45.966409 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:45.966368 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjbmm"] Jun 10 01:15:45.966961 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:45.966587 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wjbmm" podUID="48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" containerName="authorino" containerID="cri-o://853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51" gracePeriod=30 Jun 10 01:15:46.226222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.226162 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:15:46.280196 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.280165 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4n25p\" (UniqueName: \"kubernetes.io/projected/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a-kube-api-access-4n25p\") pod \"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a\" (UID: \"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a\") " Jun 10 01:15:46.282218 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.282183 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a-kube-api-access-4n25p" (OuterVolumeSpecName: "kube-api-access-4n25p") pod "48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" (UID: "48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a"). InnerVolumeSpecName "kube-api-access-4n25p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:15:46.380961 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.380924 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4n25p\" (UniqueName: \"kubernetes.io/projected/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a-kube-api-access-4n25p\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:15:46.913143 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.913110 2554 generic.go:356] "Generic (PLEG): container finished" podID="48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" containerID="853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51" exitCode=0 Jun 10 01:15:46.913318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.913206 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjbmm" event={"ID":"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a","Type":"ContainerDied","Data":"853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51"} Jun 10 01:15:46.913318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.913236 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wjbmm" event={"ID":"48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a","Type":"ContainerDied","Data":"a3aa7b046d2274882dc8478266478f1a0b6b730b1af1d121bd417a881c671e1a"} Jun 10 01:15:46.913318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.913253 2554 scope.go:117] "RemoveContainer" containerID="853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51" Jun 10 01:15:46.913318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.913209 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wjbmm" Jun 10 01:15:46.921638 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.921615 2554 scope.go:117] "RemoveContainer" containerID="853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51" Jun 10 01:15:46.921906 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:15:46.921886 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51\": container with ID starting with 853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51 not found: ID does not exist" containerID="853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51" Jun 10 01:15:46.921956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.921916 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51"} err="failed to get container status \"853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51\": rpc error: code = NotFound desc = could not find container \"853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51\": container with ID starting with 853b013474695ead9bf2f38d982aa86198acb1b00d63dadf58c98e8d8fa16f51 not found: ID does not exist" Jun 10 01:15:46.933812 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.933785 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjbmm"] Jun 10 01:15:46.939158 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:46.939134 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wjbmm"] Jun 10 01:15:47.816591 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:47.816555 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" path="/var/lib/kubelet/pods/48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a/volumes" Jun 10 01:15:49.375365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.375325 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c8df85995-mqxhv"] Jun 10 01:15:49.375848 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.375829 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" containerName="authorino" Jun 10 01:15:49.375906 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.375850 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" containerName="authorino" Jun 10 01:15:49.375947 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.375931 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="48a4b3aa-a1d0-4abb-917b-c5e5ff087a3a" containerName="authorino" Jun 10 01:15:49.378218 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.378200 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:49.380507 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.380482 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 01:15:49.380645 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.380483 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 01:15:49.380645 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.380491 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jv9vl\"" Jun 10 01:15:49.388428 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.387880 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8df85995-mqxhv"] Jun 10 01:15:49.509836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.509796 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrm2s\" (UniqueName: \"kubernetes.io/projected/91a0b223-597e-4196-adf7-3660a1c01a08-kube-api-access-lrm2s\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:49.510016 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.509885 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:49.544314 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.544273 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59dd9cb567-ffphx"] Jun 10 01:15:49.546918 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.546900 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.555519 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.555493 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-ffphx"] Jun 10 01:15:49.610921 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.610888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfsbn\" (UniqueName: \"kubernetes.io/projected/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-kube-api-access-rfsbn\") pod \"maas-controller-59dd9cb567-ffphx\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.610921 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.610934 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:49.611181 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.610973 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrm2s\" (UniqueName: \"kubernetes.io/projected/91a0b223-597e-4196-adf7-3660a1c01a08-kube-api-access-lrm2s\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:49.611181 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.610992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-webhook-cert\") pod \"maas-controller-59dd9cb567-ffphx\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.611181 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:15:49.611071 2554 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 10 01:15:49.611181 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:15:49.611167 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert podName:91a0b223-597e-4196-adf7-3660a1c01a08 nodeName:}" failed. No retries permitted until 2026-06-10 01:15:50.111145606 +0000 UTC m=+824.836747907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert") pod "maas-controller-5c8df85995-mqxhv" (UID: "91a0b223-597e-4196-adf7-3660a1c01a08") : secret "maas-controller-webhook-cert" not found Jun 10 01:15:49.619781 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.619754 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrm2s\" (UniqueName: \"kubernetes.io/projected/91a0b223-597e-4196-adf7-3660a1c01a08-kube-api-access-lrm2s\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:49.712178 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.712137 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-webhook-cert\") pod \"maas-controller-59dd9cb567-ffphx\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.712351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.712213 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfsbn\" (UniqueName: \"kubernetes.io/projected/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-kube-api-access-rfsbn\") pod \"maas-controller-59dd9cb567-ffphx\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.714645 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.714614 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-webhook-cert\") pod \"maas-controller-59dd9cb567-ffphx\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.719406 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.719385 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfsbn\" (UniqueName: \"kubernetes.io/projected/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-kube-api-access-rfsbn\") pod \"maas-controller-59dd9cb567-ffphx\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.857505 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.857464 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:49.991926 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:49.991902 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-ffphx"] Jun 10 01:15:49.994192 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:15:49.994169 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dd12c40_b8e5_45ff_97d5_3b2afbea9d22.slice/crio-1ef7111e488fe0fc51ab64c934cf778cb30173c282002251f2a37b52c0ea8c87 WatchSource:0}: Error finding container 1ef7111e488fe0fc51ab64c934cf778cb30173c282002251f2a37b52c0ea8c87: Status 404 returned error can't find the container with id 1ef7111e488fe0fc51ab64c934cf778cb30173c282002251f2a37b52c0ea8c87 Jun 10 01:15:50.115578 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:50.115540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:50.117980 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:50.117954 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert\") pod \"maas-controller-5c8df85995-mqxhv\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:50.291272 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:50.291163 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:50.418930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:50.418899 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c8df85995-mqxhv"] Jun 10 01:15:50.420663 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:15:50.420637 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a0b223_597e_4196_adf7_3660a1c01a08.slice/crio-f04f211d3047b84a6ca77dc74e189608a6fcc0d0b8482c20fe4fe9b67c637ef9 WatchSource:0}: Error finding container f04f211d3047b84a6ca77dc74e189608a6fcc0d0b8482c20fe4fe9b67c637ef9: Status 404 returned error can't find the container with id f04f211d3047b84a6ca77dc74e189608a6fcc0d0b8482c20fe4fe9b67c637ef9 Jun 10 01:15:50.937108 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:50.937031 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dd9cb567-ffphx" event={"ID":"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22","Type":"ContainerStarted","Data":"1ef7111e488fe0fc51ab64c934cf778cb30173c282002251f2a37b52c0ea8c87"} Jun 10 01:15:50.939427 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:50.939394 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-mqxhv" event={"ID":"91a0b223-597e-4196-adf7-3660a1c01a08","Type":"ContainerStarted","Data":"f04f211d3047b84a6ca77dc74e189608a6fcc0d0b8482c20fe4fe9b67c637ef9"} Jun 10 01:15:52.951565 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:52.951532 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dd9cb567-ffphx" event={"ID":"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22","Type":"ContainerStarted","Data":"5f6abf20cd1b43f4856399ee8c161b9f4b9e5edca046677042f6647516d0974b"} Jun 10 01:15:52.952047 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:52.951594 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:15:52.953162 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:52.953131 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-mqxhv" event={"ID":"91a0b223-597e-4196-adf7-3660a1c01a08","Type":"ContainerStarted","Data":"fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e"} Jun 10 01:15:52.953311 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:52.953188 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:15:52.967649 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:52.967599 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59dd9cb567-ffphx" podStartSLOduration=1.386589814 podStartE2EDuration="3.967585703s" totalImagesPullingTime="2.580995889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:52.967272525 +0000 UTC m=+827.692874869" watchObservedRunningTime="2026-06-10 01:15:52.967585703 +0000 UTC m=+827.693188067" Jun 10 01:15:52.988769 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:15:52.988717 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c8df85995-mqxhv" podStartSLOduration=1.8272277670000001 podStartE2EDuration="3.988698521s" totalImagesPullingTime="2.161470754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:15:52.988242112 +0000 UTC m=+827.713844428" watchObservedRunningTime="2026-06-10 01:15:52.988698521 +0000 UTC m=+827.714300842" Jun 10 01:16:03.962112 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:03.962064 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:16:03.962609 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:03.962168 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:16:04.012071 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.012041 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8df85995-mqxhv"] Jun 10 01:16:04.012292 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.012269 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5c8df85995-mqxhv" podUID="91a0b223-597e-4196-adf7-3660a1c01a08" containerName="manager" containerID="cri-o://fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e" gracePeriod=30 Jun 10 01:16:04.263507 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.263483 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:16:04.349353 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.349319 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert\") pod \"91a0b223-597e-4196-adf7-3660a1c01a08\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " Jun 10 01:16:04.349353 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.349365 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrm2s\" (UniqueName: \"kubernetes.io/projected/91a0b223-597e-4196-adf7-3660a1c01a08-kube-api-access-lrm2s\") pod \"91a0b223-597e-4196-adf7-3660a1c01a08\" (UID: \"91a0b223-597e-4196-adf7-3660a1c01a08\") " Jun 10 01:16:04.351622 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.351590 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a0b223-597e-4196-adf7-3660a1c01a08-kube-api-access-lrm2s" (OuterVolumeSpecName: "kube-api-access-lrm2s") pod "91a0b223-597e-4196-adf7-3660a1c01a08" (UID: "91a0b223-597e-4196-adf7-3660a1c01a08"). InnerVolumeSpecName "kube-api-access-lrm2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:16:04.351719 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.351590 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "91a0b223-597e-4196-adf7-3660a1c01a08" (UID: "91a0b223-597e-4196-adf7-3660a1c01a08"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:16:04.450561 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.450525 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/91a0b223-597e-4196-adf7-3660a1c01a08-webhook-cert\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:16:04.450561 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:04.450554 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrm2s\" (UniqueName: \"kubernetes.io/projected/91a0b223-597e-4196-adf7-3660a1c01a08-kube-api-access-lrm2s\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:16:05.008818 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.008787 2554 generic.go:356] "Generic (PLEG): container finished" podID="91a0b223-597e-4196-adf7-3660a1c01a08" containerID="fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e" exitCode=0 Jun 10 01:16:05.009222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.008828 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c8df85995-mqxhv" Jun 10 01:16:05.009222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.008868 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-mqxhv" event={"ID":"91a0b223-597e-4196-adf7-3660a1c01a08","Type":"ContainerDied","Data":"fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e"} Jun 10 01:16:05.009222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.008924 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c8df85995-mqxhv" event={"ID":"91a0b223-597e-4196-adf7-3660a1c01a08","Type":"ContainerDied","Data":"f04f211d3047b84a6ca77dc74e189608a6fcc0d0b8482c20fe4fe9b67c637ef9"} Jun 10 01:16:05.009222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.008948 2554 scope.go:117] "RemoveContainer" containerID="fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e" Jun 10 01:16:05.017998 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.017797 2554 scope.go:117] "RemoveContainer" containerID="fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e" Jun 10 01:16:05.018117 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:16:05.018068 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e\": container with ID starting with fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e not found: ID does not exist" containerID="fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e" Jun 10 01:16:05.018213 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.018124 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e"} err="failed to get container status \"fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e\": rpc error: code = NotFound desc = could not find container \"fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e\": container with ID starting with fa6ed8d05a2a73831a184b503ce6cf5dfc23c4264903d5f1a896567404b7779e not found: ID does not exist" Jun 10 01:16:05.030020 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.029993 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c8df85995-mqxhv"] Jun 10 01:16:05.034233 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.034213 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c8df85995-mqxhv"] Jun 10 01:16:05.817222 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:05.817182 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a0b223-597e-4196-adf7-3660a1c01a08" path="/var/lib/kubelet/pods/91a0b223-597e-4196-adf7-3660a1c01a08/volumes" Jun 10 01:16:23.855114 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.855065 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj"] Jun 10 01:16:23.855559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.855381 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a0b223-597e-4196-adf7-3660a1c01a08" containerName="manager" Jun 10 01:16:23.855559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.855392 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a0b223-597e-4196-adf7-3660a1c01a08" containerName="manager" Jun 10 01:16:23.855559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.855460 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a0b223-597e-4196-adf7-3660a1c01a08" containerName="manager" Jun 10 01:16:23.862003 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.861981 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:23.864010 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.863987 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 10 01:16:23.864151 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.864016 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 10 01:16:23.864151 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.864039 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-dph74\"" Jun 10 01:16:23.864837 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.864819 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 10 01:16:23.868777 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.868758 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj"] Jun 10 01:16:23.924942 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.924909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-maas-api-tls\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:23.925135 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:23.924965 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rcws\" (UniqueName: \"kubernetes.io/projected/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-kube-api-access-6rcws\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.025734 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.025697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-maas-api-tls\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.025926 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.025750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rcws\" (UniqueName: \"kubernetes.io/projected/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-kube-api-access-6rcws\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.025926 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:16:24.025846 2554 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 10 01:16:24.026066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:16:24.025933 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-maas-api-tls podName:ff7d5c8b-241b-452b-b5ee-91bc1089c1cd nodeName:}" failed. No retries permitted until 2026-06-10 01:16:24.525911642 +0000 UTC m=+859.251513954 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-maas-api-tls") pod "maas-api-7f99f5cb5d-h5psj" (UID: "ff7d5c8b-241b-452b-b5ee-91bc1089c1cd") : secret "maas-api-serving-cert" not found Jun 10 01:16:24.033570 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.033547 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rcws\" (UniqueName: \"kubernetes.io/projected/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-kube-api-access-6rcws\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.302677 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.302640 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-kf7jz"] Jun 10 01:16:24.305854 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.305837 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:24.307980 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.307956 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 01:16:24.308116 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.307999 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p4vcm\"" Jun 10 01:16:24.315298 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.315275 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-kf7jz"] Jun 10 01:16:24.342001 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.341968 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-6z96s"] Jun 10 01:16:24.345149 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.345132 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:24.352731 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.352708 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-6z96s"] Jun 10 01:16:24.429282 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.429243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp5f9\" (UniqueName: \"kubernetes.io/projected/7e8fbf0c-eb76-4198-ab00-b68decc3a2a2-kube-api-access-mp5f9\") pod \"payload-processing-699b6cd6c-6z96s\" (UID: \"7e8fbf0c-eb76-4198-ab00-b68decc3a2a2\") " pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:24.429463 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.429369 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdbl5\" (UniqueName: \"kubernetes.io/projected/53b58a45-3530-4363-a06c-f0e5fe7fb718-kube-api-access-wdbl5\") pod \"payload-pre-processing-579785bc64-kf7jz\" (UID: \"53b58a45-3530-4363-a06c-f0e5fe7fb718\") " pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:24.530653 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.530612 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdbl5\" (UniqueName: \"kubernetes.io/projected/53b58a45-3530-4363-a06c-f0e5fe7fb718-kube-api-access-wdbl5\") pod \"payload-pre-processing-579785bc64-kf7jz\" (UID: \"53b58a45-3530-4363-a06c-f0e5fe7fb718\") " pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:24.530845 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.530724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp5f9\" (UniqueName: \"kubernetes.io/projected/7e8fbf0c-eb76-4198-ab00-b68decc3a2a2-kube-api-access-mp5f9\") pod \"payload-processing-699b6cd6c-6z96s\" (UID: \"7e8fbf0c-eb76-4198-ab00-b68decc3a2a2\") " pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:24.530845 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.530785 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-maas-api-tls\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.533441 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.533414 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff7d5c8b-241b-452b-b5ee-91bc1089c1cd-maas-api-tls\") pod \"maas-api-7f99f5cb5d-h5psj\" (UID: \"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd\") " pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.538913 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.538885 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp5f9\" (UniqueName: \"kubernetes.io/projected/7e8fbf0c-eb76-4198-ab00-b68decc3a2a2-kube-api-access-mp5f9\") pod \"payload-processing-699b6cd6c-6z96s\" (UID: \"7e8fbf0c-eb76-4198-ab00-b68decc3a2a2\") " pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:24.539020 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.538949 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdbl5\" (UniqueName: \"kubernetes.io/projected/53b58a45-3530-4363-a06c-f0e5fe7fb718-kube-api-access-wdbl5\") pod \"payload-pre-processing-579785bc64-kf7jz\" (UID: \"53b58a45-3530-4363-a06c-f0e5fe7fb718\") " pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:24.616825 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.616733 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:24.655781 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.655117 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:24.760344 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.760188 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-kf7jz"] Jun 10 01:16:24.762849 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:16:24.762797 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53b58a45_3530_4363_a06c_f0e5fe7fb718.slice/crio-ee0c6d089d3388ecb23025c13858c5f4f9e53076405247463b1988758b40cdef WatchSource:0}: Error finding container ee0c6d089d3388ecb23025c13858c5f4f9e53076405247463b1988758b40cdef: Status 404 returned error can't find the container with id ee0c6d089d3388ecb23025c13858c5f4f9e53076405247463b1988758b40cdef Jun 10 01:16:24.765036 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.765016 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:16:24.773788 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.773759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:24.812541 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.812466 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-6z96s"] Jun 10 01:16:24.816176 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:16:24.816151 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8fbf0c_eb76_4198_ab00_b68decc3a2a2.slice/crio-1f7681a049874db0c4e11213a3c11efe37113cf78e65424a94ead11b81792e45 WatchSource:0}: Error finding container 1f7681a049874db0c4e11213a3c11efe37113cf78e65424a94ead11b81792e45: Status 404 returned error can't find the container with id 1f7681a049874db0c4e11213a3c11efe37113cf78e65424a94ead11b81792e45 Jun 10 01:16:24.909509 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:24.909470 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj"] Jun 10 01:16:24.911906 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:16:24.911873 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff7d5c8b_241b_452b_b5ee_91bc1089c1cd.slice/crio-4a1f4f758c5b37702946a2a928df88a5bdf8d85ca2ad9ff9553f347671b8a918 WatchSource:0}: Error finding container 4a1f4f758c5b37702946a2a928df88a5bdf8d85ca2ad9ff9553f347671b8a918: Status 404 returned error can't find the container with id 4a1f4f758c5b37702946a2a928df88a5bdf8d85ca2ad9ff9553f347671b8a918 Jun 10 01:16:25.099054 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:25.099003 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" event={"ID":"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd","Type":"ContainerStarted","Data":"4a1f4f758c5b37702946a2a928df88a5bdf8d85ca2ad9ff9553f347671b8a918"} Jun 10 01:16:25.100468 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:25.100433 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" event={"ID":"53b58a45-3530-4363-a06c-f0e5fe7fb718","Type":"ContainerStarted","Data":"ee0c6d089d3388ecb23025c13858c5f4f9e53076405247463b1988758b40cdef"} Jun 10 01:16:25.101823 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:25.101789 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" event={"ID":"7e8fbf0c-eb76-4198-ab00-b68decc3a2a2","Type":"ContainerStarted","Data":"1f7681a049874db0c4e11213a3c11efe37113cf78e65424a94ead11b81792e45"} Jun 10 01:16:29.126396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.126358 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" event={"ID":"53b58a45-3530-4363-a06c-f0e5fe7fb718","Type":"ContainerStarted","Data":"9dfcb6d76654d93e2d19d4fecb26cda15300bb72e31cb2c7bb65d9fe8660bc06"} Jun 10 01:16:29.126855 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.126509 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:29.127831 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.127809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" event={"ID":"7e8fbf0c-eb76-4198-ab00-b68decc3a2a2","Type":"ContainerStarted","Data":"e0579cff1c89c05ed99c28b87b344a0f4e2ce7407faae1ae40306b21da89404d"} Jun 10 01:16:29.127924 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.127869 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:29.129269 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.129248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" event={"ID":"ff7d5c8b-241b-452b-b5ee-91bc1089c1cd","Type":"ContainerStarted","Data":"9bafdc480d08571229c9475391a60134f3440558983d83841a9de9c861b98328"} Jun 10 01:16:29.129352 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.129290 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:29.143105 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.142187 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" podStartSLOduration=1.499811893 podStartE2EDuration="5.142124831s" totalImagesPullingTime="3.642312938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:16:29.142114756 +0000 UTC m=+863.867717075" watchObservedRunningTime="2026-06-10 01:16:29.142124831 +0000 UTC m=+863.867727148" Jun 10 01:16:29.160875 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.160815 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" podStartSLOduration=2.672494004 podStartE2EDuration="6.160799523s" totalImagesPullingTime="3.488305519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:16:29.159302379 +0000 UTC m=+863.884904697" watchObservedRunningTime="2026-06-10 01:16:29.160799523 +0000 UTC m=+863.886401840" Jun 10 01:16:29.178545 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:29.178479 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" podStartSLOduration=1.602741067 podStartE2EDuration="5.178455375s" totalImagesPullingTime="3.575714308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:16:29.176846142 +0000 UTC m=+863.902448484" watchObservedRunningTime="2026-06-10 01:16:29.178455375 +0000 UTC m=+863.904057695" Jun 10 01:16:32.144202 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:32.144168 2554 generic.go:356] "Generic (PLEG): container finished" podID="83b26584-3d46-409c-b13d-b46b9fe675dd" containerID="cf45043ec3995c66bcaa0e3555a056a2528b4f24df52d2df92c9ea8c1dae757f" exitCode=0 Jun 10 01:16:32.144728 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:32.144248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" event={"ID":"83b26584-3d46-409c-b13d-b46b9fe675dd","Type":"ContainerDied","Data":"cf45043ec3995c66bcaa0e3555a056a2528b4f24df52d2df92c9ea8c1dae757f"} Jun 10 01:16:32.144797 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:32.144751 2554 scope.go:117] "RemoveContainer" containerID="cf45043ec3995c66bcaa0e3555a056a2528b4f24df52d2df92c9ea8c1dae757f" Jun 10 01:16:32.145762 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:32.145735 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:16:32.145849 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:32.145800 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:16:32.145849 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:32.145832 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:16:33.151444 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:33.151404 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" event={"ID":"83b26584-3d46-409c-b13d-b46b9fe675dd","Type":"ContainerStarted","Data":"75bb90dc21baa56aa40cbb8711db88a2537d8314626335638c4c09c2a662dc7c"} Jun 10 01:16:33.485915 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:33.485804 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:16:33.808992 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:33.808895 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:16:33.810056 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:33.810031 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-n622k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 10 01:16:33.810155 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:33.810099 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" podUID="83b26584-3d46-409c-b13d-b46b9fe675dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 10 01:16:34.809101 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:34.809042 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-n622k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 10 01:16:34.809564 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:34.809132 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" podUID="83b26584-3d46-409c-b13d-b46b9fe675dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 10 01:16:35.139823 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:35.139795 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-7f99f5cb5d-h5psj" Jun 10 01:16:35.808208 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:35.808177 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-n622k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 10 01:16:35.808379 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:35.808233 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" podUID="83b26584-3d46-409c-b13d-b46b9fe675dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 10 01:16:36.809061 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:36.809007 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-n622k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body= Jun 10 01:16:36.809589 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:36.809118 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" podUID="83b26584-3d46-409c-b13d-b46b9fe675dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" Jun 10 01:16:36.952858 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:36.952827 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:16:36.953103 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:36.953059 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" containerID="cri-o://99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a" gracePeriod=30 Jun 10 01:16:37.817877 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:37.817846 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:16:37.819025 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:37.819004 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-n622k" Jun 10 01:16:38.994406 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:38.994373 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.171569 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.171542 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/4929781a-0f0d-4513-b54d-b1359626c07b-kube-api-access-w5dgn\") pod \"4929781a-0f0d-4513-b54d-b1359626c07b\" (UID: \"4929781a-0f0d-4513-b54d-b1359626c07b\") " Jun 10 01:16:39.173673 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.173637 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4929781a-0f0d-4513-b54d-b1359626c07b-kube-api-access-w5dgn" (OuterVolumeSpecName: "kube-api-access-w5dgn") pod "4929781a-0f0d-4513-b54d-b1359626c07b" (UID: "4929781a-0f0d-4513-b54d-b1359626c07b"). InnerVolumeSpecName "kube-api-access-w5dgn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:16:39.182440 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.182412 2554 generic.go:356] "Generic (PLEG): container finished" podID="4929781a-0f0d-4513-b54d-b1359626c07b" containerID="99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a" exitCode=143 Jun 10 01:16:39.182566 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.182458 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.182566 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.182488 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4929781a-0f0d-4513-b54d-b1359626c07b","Type":"ContainerDied","Data":"99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a"} Jun 10 01:16:39.182566 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.182544 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4929781a-0f0d-4513-b54d-b1359626c07b","Type":"ContainerDied","Data":"f00dfeeb6da3427942094996318f7c174fde8999e757bcfaafc5b79602146856"} Jun 10 01:16:39.182680 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.182572 2554 scope.go:117] "RemoveContainer" containerID="99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a" Jun 10 01:16:39.191938 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.191912 2554 scope.go:117] "RemoveContainer" containerID="99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a" Jun 10 01:16:39.192246 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:16:39.192228 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a\": container with ID starting with 99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a not found: ID does not exist" containerID="99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a" Jun 10 01:16:39.192299 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.192255 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a"} err="failed to get container status \"99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a\": rpc error: code = NotFound desc = could not find container \"99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a\": container with ID starting with 99025949e6c38feeadb79eb89a1aea3a40a2922bf995b701deb77fcbd935298a not found: ID does not exist" Jun 10 01:16:39.205061 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.205034 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:16:39.208465 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.208435 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:16:39.228768 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.228737 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:16:39.229204 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.229187 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" Jun 10 01:16:39.229290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.229206 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" Jun 10 01:16:39.229344 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.229325 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" containerName="keycloak" Jun 10 01:16:39.231842 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.231822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.234145 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.234117 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 01:16:39.234236 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.234143 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 01:16:39.234296 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.234282 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 01:16:39.234345 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.234291 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 01:16:39.234533 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.234520 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-4xffv\"" Jun 10 01:16:39.243335 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.243302 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:16:39.272765 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.272728 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5dgn\" (UniqueName: \"kubernetes.io/projected/4929781a-0f0d-4513-b54d-b1359626c07b-kube-api-access-w5dgn\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:16:39.373290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.373248 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/94e06bb1-f40e-42a8-ac03-0122502d9eed-test-realms\") pod \"maas-keycloak-0\" (UID: \"94e06bb1-f40e-42a8-ac03-0122502d9eed\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.373290 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.373287 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqzrb\" (UniqueName: \"kubernetes.io/projected/94e06bb1-f40e-42a8-ac03-0122502d9eed-kube-api-access-tqzrb\") pod \"maas-keycloak-0\" (UID: \"94e06bb1-f40e-42a8-ac03-0122502d9eed\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.474481 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.474383 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/94e06bb1-f40e-42a8-ac03-0122502d9eed-test-realms\") pod \"maas-keycloak-0\" (UID: \"94e06bb1-f40e-42a8-ac03-0122502d9eed\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.474481 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.474428 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqzrb\" (UniqueName: \"kubernetes.io/projected/94e06bb1-f40e-42a8-ac03-0122502d9eed-kube-api-access-tqzrb\") pod \"maas-keycloak-0\" (UID: \"94e06bb1-f40e-42a8-ac03-0122502d9eed\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.475160 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.475140 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/94e06bb1-f40e-42a8-ac03-0122502d9eed-test-realms\") pod \"maas-keycloak-0\" (UID: \"94e06bb1-f40e-42a8-ac03-0122502d9eed\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.482543 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.482519 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqzrb\" (UniqueName: \"kubernetes.io/projected/94e06bb1-f40e-42a8-ac03-0122502d9eed-kube-api-access-tqzrb\") pod \"maas-keycloak-0\" (UID: \"94e06bb1-f40e-42a8-ac03-0122502d9eed\") " pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.542259 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.542219 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:39.676064 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.676035 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 01:16:39.678087 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:16:39.678051 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94e06bb1_f40e_42a8_ac03_0122502d9eed.slice/crio-488f8c8d6e23efd2c6cb960e8fbe65cd9e97254f3d262154c2573ec582f81a76 WatchSource:0}: Error finding container 488f8c8d6e23efd2c6cb960e8fbe65cd9e97254f3d262154c2573ec582f81a76: Status 404 returned error can't find the container with id 488f8c8d6e23efd2c6cb960e8fbe65cd9e97254f3d262154c2573ec582f81a76 Jun 10 01:16:39.817815 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:39.817732 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4929781a-0f0d-4513-b54d-b1359626c07b" path="/var/lib/kubelet/pods/4929781a-0f0d-4513-b54d-b1359626c07b/volumes" Jun 10 01:16:40.136355 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.136265 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-6z96s" Jun 10 01:16:40.136756 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.136596 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-kf7jz" Jun 10 01:16:40.190505 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.190472 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"94e06bb1-f40e-42a8-ac03-0122502d9eed","Type":"ContainerStarted","Data":"3965ec16b73f8025c6e36d11346d6788d225776ec324b6003717ebf2e6de893a"} Jun 10 01:16:40.190696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.190524 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"94e06bb1-f40e-42a8-ac03-0122502d9eed","Type":"ContainerStarted","Data":"488f8c8d6e23efd2c6cb960e8fbe65cd9e97254f3d262154c2573ec582f81a76"} Jun 10 01:16:40.206681 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.206621 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.881513318 podStartE2EDuration="1.206596437s" totalImagesPullingTime="325.083119ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:16:40.205884003 +0000 UTC m=+874.931486321" watchObservedRunningTime="2026-06-10 01:16:40.206596437 +0000 UTC m=+874.932198755" Jun 10 01:16:40.542705 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.542664 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:40.544351 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:40.544314 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:41.543112 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:41.543030 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:42.543563 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:42.543505 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:43.543579 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:43.543517 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:44.543136 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:44.543057 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:45.543441 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:45.543396 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:46.542735 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:46.542675 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:47.543575 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:47.543524 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:48.543336 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:48.543280 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:49.542890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:49.542837 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:49.543383 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:49.543344 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:50.543361 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:50.543306 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:51.543433 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:51.543389 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:52.543418 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:52.543310 2554 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 10 01:16:53.643415 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:53.642668 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 01:16:53.662686 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:16:53.662628 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="94e06bb1-f40e-42a8-ac03-0122502d9eed" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 01:17:03.649102 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:03.649033 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 01:17:05.793477 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:05.793449 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:17:05.795047 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:05.795026 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:17:05.798431 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:05.798414 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:17:05.799838 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:05.799817 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:17:05.804737 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:05.804719 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:17:05.806135 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:05.806120 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:17:26.175921 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.175877 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v"] Jun 10 01:17:26.179373 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.179347 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.182342 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.182319 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 01:17:26.182473 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.182319 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m7fhg\"" Jun 10 01:17:26.182473 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.182378 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 01:17:26.182473 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.182390 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 01:17:26.187311 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.187290 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v"] Jun 10 01:17:26.231696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.231666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.231696 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.231698 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.231903 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.231722 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.231903 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.231809 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.231903 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.231857 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.232002 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.231914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hshc\" (UniqueName: \"kubernetes.io/projected/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-kube-api-access-8hshc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.332850 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.332814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.332850 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.332852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333107 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.332884 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333107 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.332927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333107 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.332988 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333107 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.333037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hshc\" (UniqueName: \"kubernetes.io/projected/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-kube-api-access-8hshc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333350 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.333324 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333350 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.333343 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.333451 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.333392 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.335270 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.335243 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.335669 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.335641 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.340686 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.340664 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hshc\" (UniqueName: \"kubernetes.io/projected/fdea62ce-9aef-40d4-b7b1-547daa1d6ceb-kube-api-access-8hshc\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v\" (UID: \"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.493086 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.492978 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:17:26.627836 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:26.627809 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v"] Jun 10 01:17:26.630177 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:17:26.630147 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdea62ce_9aef_40d4_b7b1_547daa1d6ceb.slice/crio-47dd33eea5f78b39b49f6020b9614a67d54938555591e82b11aa0be00c25a183 WatchSource:0}: Error finding container 47dd33eea5f78b39b49f6020b9614a67d54938555591e82b11aa0be00c25a183: Status 404 returned error can't find the container with id 47dd33eea5f78b39b49f6020b9614a67d54938555591e82b11aa0be00c25a183 Jun 10 01:17:27.450338 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:27.450283 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" event={"ID":"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb","Type":"ContainerStarted","Data":"47dd33eea5f78b39b49f6020b9614a67d54938555591e82b11aa0be00c25a183"} Jun 10 01:17:30.466086 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:30.466037 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" event={"ID":"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb","Type":"ContainerStarted","Data":"9e535fc0e91961167ac36cab4a54f775fbc2b2d6cd284eda63d7d8ea8f1a000f"} Jun 10 01:17:33.263652 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.263551 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc"] Jun 10 01:17:33.269037 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.269007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.271376 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.271348 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 10 01:17:33.276485 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.276454 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc"] Jun 10 01:17:33.286980 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.286945 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.287196 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.287007 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.287196 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.287105 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.287299 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.287185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.287299 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.287230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtcvg\" (UniqueName: \"kubernetes.io/projected/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-kube-api-access-rtcvg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.287299 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.287289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.388764 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.388724 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.388956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.388791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.388956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.388843 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.388956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.388887 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.388956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.388919 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtcvg\" (UniqueName: \"kubernetes.io/projected/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-kube-api-access-rtcvg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.388956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.388946 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.389336 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.389314 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.389414 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.389322 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.389414 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.389394 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.391231 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.391205 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.391362 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.391344 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.396289 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.396266 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtcvg\" (UniqueName: \"kubernetes.io/projected/a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7-kube-api-access-rtcvg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-hf7vc\" (UID: \"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.581762 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.581667 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:33.733420 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:33.727142 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc"] Jun 10 01:17:33.733420 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:17:33.730895 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda99caf5a_e4cd_4e07_8e6d_cf1987d03ec7.slice/crio-63ed9f7c8d5ca35992c7d9a02d123d2fb849019dae851debb974a2a78a59a8a6 WatchSource:0}: Error finding container 63ed9f7c8d5ca35992c7d9a02d123d2fb849019dae851debb974a2a78a59a8a6: Status 404 returned error can't find the container with id 63ed9f7c8d5ca35992c7d9a02d123d2fb849019dae851debb974a2a78a59a8a6 Jun 10 01:17:34.488244 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:34.488193 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" event={"ID":"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7","Type":"ContainerStarted","Data":"a74f4cbe5da0526f02bc077df3fe6ef15dccb03fc45f62dafc07fb17c137a900"} Jun 10 01:17:34.488661 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:34.488265 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" event={"ID":"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7","Type":"ContainerStarted","Data":"63ed9f7c8d5ca35992c7d9a02d123d2fb849019dae851debb974a2a78a59a8a6"} Jun 10 01:17:35.494810 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:35.494715 2554 generic.go:356] "Generic (PLEG): container finished" podID="a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7" containerID="a74f4cbe5da0526f02bc077df3fe6ef15dccb03fc45f62dafc07fb17c137a900" exitCode=0 Jun 10 01:17:35.495205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:35.494816 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" event={"ID":"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7","Type":"ContainerDied","Data":"a74f4cbe5da0526f02bc077df3fe6ef15dccb03fc45f62dafc07fb17c137a900"} Jun 10 01:17:37.508861 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:37.508824 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" event={"ID":"a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7","Type":"ContainerStarted","Data":"c2db8142a41e4df1af37c221452823d2990e3d72023bc433c003be18284d5902"} Jun 10 01:17:37.529392 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:37.529333 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" podStartSLOduration=2.132243913 podStartE2EDuration="4.529310499s" totalImagesPullingTime="1.015974831s" totalInitContainerRuntime="1.381091755s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:17:37.527019163 +0000 UTC m=+932.252621493" watchObservedRunningTime="2026-06-10 01:17:37.529310499 +0000 UTC m=+932.254912821" Jun 10 01:17:43.582324 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:43.582287 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:43.582721 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:43.582346 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:43.594552 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:43.594526 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:44.553681 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:44.553650 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-hf7vc" Jun 10 01:17:56.790966 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.790928 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz"] Jun 10 01:17:56.794598 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.794575 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:56.796885 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.796851 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 10 01:17:56.809049 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.809021 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz"] Jun 10 01:17:56.918448 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.918410 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:56.918663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.918465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2svwn\" (UniqueName: \"kubernetes.io/projected/b81c0684-927e-4f37-b6dc-ca770edb9910-kube-api-access-2svwn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:56.918663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.918554 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:56.918663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.918598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:56.918663 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.918631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:56.918846 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:56.918721 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b81c0684-927e-4f37-b6dc-ca770edb9910-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.019452 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.019408 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b81c0684-927e-4f37-b6dc-ca770edb9910-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.019656 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.019476 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.019656 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.019516 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2svwn\" (UniqueName: \"kubernetes.io/projected/b81c0684-927e-4f37-b6dc-ca770edb9910-kube-api-access-2svwn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.019656 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.019540 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.019656 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.019560 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.019656 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.019582 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.020026 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.020000 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.020168 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.020038 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.020168 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.020103 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.021854 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.021834 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b81c0684-927e-4f37-b6dc-ca770edb9910-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.022127 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.022109 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b81c0684-927e-4f37-b6dc-ca770edb9910-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.026853 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.026825 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2svwn\" (UniqueName: \"kubernetes.io/projected/b81c0684-927e-4f37-b6dc-ca770edb9910-kube-api-access-2svwn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz\" (UID: \"b81c0684-927e-4f37-b6dc-ca770edb9910\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.105517 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.105429 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:17:57.239779 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.239747 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz"] Jun 10 01:17:57.241899 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:17:57.241870 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb81c0684_927e_4f37_b6dc_ca770edb9910.slice/crio-c8c2d5ed54073a785102895fb61a51565c5cddf5388e2ea2b283fdc5d077aec5 WatchSource:0}: Error finding container c8c2d5ed54073a785102895fb61a51565c5cddf5388e2ea2b283fdc5d077aec5: Status 404 returned error can't find the container with id c8c2d5ed54073a785102895fb61a51565c5cddf5388e2ea2b283fdc5d077aec5 Jun 10 01:17:57.604101 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.604046 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" event={"ID":"b81c0684-927e-4f37-b6dc-ca770edb9910","Type":"ContainerStarted","Data":"2c0ff15a231382fe5970b9c23baf2718abf395af51fc55a6e42f3ffdd0b950c0"} Jun 10 01:17:57.604278 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:17:57.604154 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" event={"ID":"b81c0684-927e-4f37-b6dc-ca770edb9910","Type":"ContainerStarted","Data":"c8c2d5ed54073a785102895fb61a51565c5cddf5388e2ea2b283fdc5d077aec5"} Jun 10 01:18:35.785970 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:35.785880 2554 generic.go:356] "Generic (PLEG): container finished" podID="fdea62ce-9aef-40d4-b7b1-547daa1d6ceb" containerID="9e535fc0e91961167ac36cab4a54f775fbc2b2d6cd284eda63d7d8ea8f1a000f" exitCode=0 Jun 10 01:18:35.785970 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:35.785929 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" event={"ID":"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb","Type":"ContainerDied","Data":"9e535fc0e91961167ac36cab4a54f775fbc2b2d6cd284eda63d7d8ea8f1a000f"} Jun 10 01:18:36.793361 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:36.793327 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" event={"ID":"fdea62ce-9aef-40d4-b7b1-547daa1d6ceb","Type":"ContainerStarted","Data":"f1c5a6915335b5c59ecd0c82a75df6c0ca680b1575df3b8add72021842151936"} Jun 10 01:18:36.816580 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:36.816504 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" podStartSLOduration=1.8412690409999999 podStartE2EDuration="1m10.816487462s" totalImagesPullingTime="3.895502931s" totalInitContainerRuntime="1m5.07971549s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:17:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:18:36.815457767 +0000 UTC m=+991.541060113" watchObservedRunningTime="2026-06-10 01:18:36.816487462 +0000 UTC m=+991.542089806" Jun 10 01:18:46.493408 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:46.493358 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:18:46.493794 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:46.493439 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:18:46.506141 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:46.506113 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:18:46.852095 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:18:46.851990 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v" Jun 10 01:19:51.146642 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:51.146604 2554 generic.go:356] "Generic (PLEG): container finished" podID="b81c0684-927e-4f37-b6dc-ca770edb9910" containerID="2c0ff15a231382fe5970b9c23baf2718abf395af51fc55a6e42f3ffdd0b950c0" exitCode=0 Jun 10 01:19:51.147152 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:51.146658 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" event={"ID":"b81c0684-927e-4f37-b6dc-ca770edb9910","Type":"ContainerDied","Data":"2c0ff15a231382fe5970b9c23baf2718abf395af51fc55a6e42f3ffdd0b950c0"} Jun 10 01:19:52.153883 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:52.153803 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" event={"ID":"b81c0684-927e-4f37-b6dc-ca770edb9910","Type":"ContainerStarted","Data":"c9b51359d2292f276843b2d282f9e9e384dcc013c4fdfb5b13d5252ddb82e02e"} Jun 10 01:19:52.172150 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:52.172095 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" podStartSLOduration=2.305752335 podStartE2EDuration="1m56.172061399s" totalImagesPullingTime="190.56284ms" totalInitContainerRuntime="1m53.675746224s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:17:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:19:52.170067629 +0000 UTC m=+1066.895669956" watchObservedRunningTime="2026-06-10 01:19:52.172061399 +0000 UTC m=+1066.897663726" Jun 10 01:19:57.105674 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:57.105632 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:19:57.106183 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:57.105732 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:19:57.118262 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:57.118237 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:19:57.187577 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:19:57.187549 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz" Jun 10 01:20:36.250121 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.250067 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-ffphx"] Jun 10 01:20:36.250615 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.250320 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-59dd9cb567-ffphx" podUID="7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" containerName="manager" containerID="cri-o://5f6abf20cd1b43f4856399ee8c161b9f4b9e5edca046677042f6647516d0974b" gracePeriod=30 Jun 10 01:20:36.366449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.366418 2554 generic.go:356] "Generic (PLEG): container finished" podID="7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" containerID="5f6abf20cd1b43f4856399ee8c161b9f4b9e5edca046677042f6647516d0974b" exitCode=0 Jun 10 01:20:36.366555 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.366505 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dd9cb567-ffphx" event={"ID":"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22","Type":"ContainerDied","Data":"5f6abf20cd1b43f4856399ee8c161b9f4b9e5edca046677042f6647516d0974b"} Jun 10 01:20:36.500571 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.500505 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:20:36.570031 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.570002 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfsbn\" (UniqueName: \"kubernetes.io/projected/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-kube-api-access-rfsbn\") pod \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " Jun 10 01:20:36.570229 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.570040 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-webhook-cert\") pod \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\" (UID: \"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22\") " Jun 10 01:20:36.572128 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.572102 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" (UID: "7dd12c40-b8e5-45ff-97d5-3b2afbea9d22"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 01:20:36.572128 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.572113 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-kube-api-access-rfsbn" (OuterVolumeSpecName: "kube-api-access-rfsbn") pod "7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" (UID: "7dd12c40-b8e5-45ff-97d5-3b2afbea9d22"). InnerVolumeSpecName "kube-api-access-rfsbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:20:36.670994 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.670958 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfsbn\" (UniqueName: \"kubernetes.io/projected/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-kube-api-access-rfsbn\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:20:36.670994 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:36.670990 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22-webhook-cert\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:20:37.372591 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:37.372560 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dd9cb567-ffphx" Jun 10 01:20:37.372591 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:37.372583 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dd9cb567-ffphx" event={"ID":"7dd12c40-b8e5-45ff-97d5-3b2afbea9d22","Type":"ContainerDied","Data":"1ef7111e488fe0fc51ab64c934cf778cb30173c282002251f2a37b52c0ea8c87"} Jun 10 01:20:37.373118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:37.372664 2554 scope.go:117] "RemoveContainer" containerID="5f6abf20cd1b43f4856399ee8c161b9f4b9e5edca046677042f6647516d0974b" Jun 10 01:20:37.394449 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:37.394417 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-ffphx"] Jun 10 01:20:37.396772 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:37.396745 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-ffphx"] Jun 10 01:20:37.816906 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:37.816863 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" path="/var/lib/kubelet/pods/7dd12c40-b8e5-45ff-97d5-3b2afbea9d22/volumes" Jun 10 01:20:38.158710 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.158678 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59dd9cb567-dm7qr"] Jun 10 01:20:38.159058 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.159047 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" containerName="manager" Jun 10 01:20:38.159118 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.159060 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" containerName="manager" Jun 10 01:20:38.159224 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.159212 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dd12c40-b8e5-45ff-97d5-3b2afbea9d22" containerName="manager" Jun 10 01:20:38.163607 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.163586 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.165847 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.165824 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 01:20:38.166729 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.166707 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-jv9vl\"" Jun 10 01:20:38.166840 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.166753 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 01:20:38.170309 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.170287 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-dm7qr"] Jun 10 01:20:38.287005 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.286966 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpb9t\" (UniqueName: \"kubernetes.io/projected/7ef89a8a-74c4-452a-a470-e8597688442d-kube-api-access-xpb9t\") pod \"maas-controller-59dd9cb567-dm7qr\" (UID: \"7ef89a8a-74c4-452a-a470-e8597688442d\") " pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.287005 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.287006 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ef89a8a-74c4-452a-a470-e8597688442d-webhook-cert\") pod \"maas-controller-59dd9cb567-dm7qr\" (UID: \"7ef89a8a-74c4-452a-a470-e8597688442d\") " pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.387837 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.387804 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ef89a8a-74c4-452a-a470-e8597688442d-webhook-cert\") pod \"maas-controller-59dd9cb567-dm7qr\" (UID: \"7ef89a8a-74c4-452a-a470-e8597688442d\") " pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.388231 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.387911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpb9t\" (UniqueName: \"kubernetes.io/projected/7ef89a8a-74c4-452a-a470-e8597688442d-kube-api-access-xpb9t\") pod \"maas-controller-59dd9cb567-dm7qr\" (UID: \"7ef89a8a-74c4-452a-a470-e8597688442d\") " pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.390375 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.390352 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ef89a8a-74c4-452a-a470-e8597688442d-webhook-cert\") pod \"maas-controller-59dd9cb567-dm7qr\" (UID: \"7ef89a8a-74c4-452a-a470-e8597688442d\") " pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.397802 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.397778 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpb9t\" (UniqueName: \"kubernetes.io/projected/7ef89a8a-74c4-452a-a470-e8597688442d-kube-api-access-xpb9t\") pod \"maas-controller-59dd9cb567-dm7qr\" (UID: \"7ef89a8a-74c4-452a-a470-e8597688442d\") " pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.475049 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.474943 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:38.606593 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:38.606566 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59dd9cb567-dm7qr"] Jun 10 01:20:38.608830 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:20:38.608806 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef89a8a_74c4_452a_a470_e8597688442d.slice/crio-a69859b8eafddad33570230a4087b31543cc45386bfaaa364483ea62177b7495 WatchSource:0}: Error finding container a69859b8eafddad33570230a4087b31543cc45386bfaaa364483ea62177b7495: Status 404 returned error can't find the container with id a69859b8eafddad33570230a4087b31543cc45386bfaaa364483ea62177b7495 Jun 10 01:20:39.384941 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:39.384806 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" event={"ID":"7ef89a8a-74c4-452a-a470-e8597688442d","Type":"ContainerStarted","Data":"1abddadd03882dc06ef18e414948e8804a6b0361eb3e6bd9ac56825622db6b52"} Jun 10 01:20:39.384941 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:39.384859 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" event={"ID":"7ef89a8a-74c4-452a-a470-e8597688442d","Type":"ContainerStarted","Data":"a69859b8eafddad33570230a4087b31543cc45386bfaaa364483ea62177b7495"} Jun 10 01:20:39.384941 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:39.384896 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:20:39.399937 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:39.399891 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" podStartSLOduration=1.068971976 podStartE2EDuration="1.399874904s" totalImagesPullingTime="330.902928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:20:39.399591401 +0000 UTC m=+1114.125193749" watchObservedRunningTime="2026-06-10 01:20:39.399874904 +0000 UTC m=+1114.125477220" Jun 10 01:20:50.395875 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:20:50.395842 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59dd9cb567-dm7qr" Jun 10 01:22:05.824376 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:22:05.824349 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:22:05.827065 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:22:05.825994 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:22:05.829059 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:22:05.829037 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:22:05.830725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:22:05.830705 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:22:05.835106 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:22:05.835069 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:22:05.836482 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:22:05.836463 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:27:05.852821 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:27:05.852686 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:27:05.856316 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:27:05.854609 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:27:05.857162 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:27:05.857140 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:27:05.858973 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:27:05.858954 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:27:05.862901 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:27:05.862882 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:27:05.864833 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:27:05.864807 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:31:01.359315 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.359282 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf"] Jun 10 01:31:01.359821 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.359492 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" podUID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" containerName="manager" containerID="cri-o://28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03" gracePeriod=10 Jun 10 01:31:01.410608 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.410570 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" podUID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.27:8081/readyz\": dial tcp 10.134.0.27:8081: connect: connection refused" Jun 10 01:31:01.624687 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.624621 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:31:01.730948 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.730912 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-extensions-socket-volume\") pod \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " Jun 10 01:31:01.731162 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.731030 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2x66\" (UniqueName: \"kubernetes.io/projected/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-kube-api-access-c2x66\") pod \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\" (UID: \"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2\") " Jun 10 01:31:01.731322 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.731300 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" (UID: "e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:31:01.733001 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.732975 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-kube-api-access-c2x66" (OuterVolumeSpecName: "kube-api-access-c2x66") pod "e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" (UID: "e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2"). InnerVolumeSpecName "kube-api-access-c2x66". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:31:01.832512 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.832486 2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-extensions-socket-volume\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:31:01.832512 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:01.832512 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2x66\" (UniqueName: \"kubernetes.io/projected/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2-kube-api-access-c2x66\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:31:02.360984 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.360949 2554 generic.go:356] "Generic (PLEG): container finished" podID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" containerID="28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03" exitCode=0 Jun 10 01:31:02.361455 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.361000 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" Jun 10 01:31:02.361455 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.361010 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" event={"ID":"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2","Type":"ContainerDied","Data":"28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03"} Jun 10 01:31:02.361455 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.361051 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf" event={"ID":"e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2","Type":"ContainerDied","Data":"c3125b0ebe8e63b481d90f9865d611c0e777e0b07843084d705a7b6d6184313e"} Jun 10 01:31:02.361455 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.361071 2554 scope.go:117] "RemoveContainer" containerID="28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03" Jun 10 01:31:02.373743 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.373723 2554 scope.go:117] "RemoveContainer" containerID="28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03" Jun 10 01:31:02.374066 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:31:02.374046 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03\": container with ID starting with 28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03 not found: ID does not exist" containerID="28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03" Jun 10 01:31:02.374179 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.374088 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03"} err="failed to get container status \"28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03\": rpc error: code = NotFound desc = could not find container \"28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03\": container with ID starting with 28b4d2bacb3f9eefd0b639dd4f3f286f2458b8e45ebc43e79a1f51e09463ac03 not found: ID does not exist" Jun 10 01:31:02.378254 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.378222 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf"] Jun 10 01:31:02.385102 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:02.381996 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-kfpkf"] Jun 10 01:31:03.818376 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:31:03.818341 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" path="/var/lib/kubelet/pods/e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2/volumes" Jun 10 01:32:05.881094 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:05.880975 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:32:05.884225 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:05.884205 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:32:05.885559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:05.885538 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:32:05.888708 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:05.888689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:32:05.891493 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:05.891474 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:32:05.894457 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:05.894439 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:32:07.489494 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.489463 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x"] Jun 10 01:32:07.490013 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.489994 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" containerName="manager" Jun 10 01:32:07.490112 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.490017 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" containerName="manager" Jun 10 01:32:07.490180 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.490126 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0656ac6-b282-4c44-ac8e-f1bbc18e2cf2" containerName="manager" Jun 10 01:32:07.493061 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.493040 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.495432 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.495416 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-kb6jf\"" Jun 10 01:32:07.505031 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.505010 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x"] Jun 10 01:32:07.646608 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.646576 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slkb4\" (UniqueName: \"kubernetes.io/projected/55200bc4-f4f7-42e7-ae9d-8bb581a8061f-kube-api-access-slkb4\") pod \"kuadrant-operator-controller-manager-86878c769f-w2k7x\" (UID: \"55200bc4-f4f7-42e7-ae9d-8bb581a8061f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.646781 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.646634 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55200bc4-f4f7-42e7-ae9d-8bb581a8061f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w2k7x\" (UID: \"55200bc4-f4f7-42e7-ae9d-8bb581a8061f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.747379 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.747284 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slkb4\" (UniqueName: \"kubernetes.io/projected/55200bc4-f4f7-42e7-ae9d-8bb581a8061f-kube-api-access-slkb4\") pod \"kuadrant-operator-controller-manager-86878c769f-w2k7x\" (UID: \"55200bc4-f4f7-42e7-ae9d-8bb581a8061f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.747379 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.747374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55200bc4-f4f7-42e7-ae9d-8bb581a8061f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w2k7x\" (UID: \"55200bc4-f4f7-42e7-ae9d-8bb581a8061f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.747752 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.747734 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55200bc4-f4f7-42e7-ae9d-8bb581a8061f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w2k7x\" (UID: \"55200bc4-f4f7-42e7-ae9d-8bb581a8061f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.758044 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.758014 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slkb4\" (UniqueName: \"kubernetes.io/projected/55200bc4-f4f7-42e7-ae9d-8bb581a8061f-kube-api-access-slkb4\") pod \"kuadrant-operator-controller-manager-86878c769f-w2k7x\" (UID: \"55200bc4-f4f7-42e7-ae9d-8bb581a8061f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.803046 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.803003 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:07.961093 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:07.961047 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x"] Jun 10 01:32:07.964725 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:32:07.964685 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55200bc4_f4f7_42e7_ae9d_8bb581a8061f.slice/crio-c87f8a91c89f9f2bc6b0aec5a5a890ee5c991aee824ff9b1d93da80221b5d97d WatchSource:0}: Error finding container c87f8a91c89f9f2bc6b0aec5a5a890ee5c991aee824ff9b1d93da80221b5d97d: Status 404 returned error can't find the container with id c87f8a91c89f9f2bc6b0aec5a5a890ee5c991aee824ff9b1d93da80221b5d97d Jun 10 01:32:08.679763 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:08.679720 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" event={"ID":"55200bc4-f4f7-42e7-ae9d-8bb581a8061f","Type":"ContainerStarted","Data":"7b1ce73c4757ec3b796d36de270170146bbe1efabb706a6434e5cf59774d95ab"} Jun 10 01:32:08.680172 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:08.679777 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" event={"ID":"55200bc4-f4f7-42e7-ae9d-8bb581a8061f","Type":"ContainerStarted","Data":"c87f8a91c89f9f2bc6b0aec5a5a890ee5c991aee824ff9b1d93da80221b5d97d"} Jun 10 01:32:08.680172 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:08.679799 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:32:08.698328 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:08.698283 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" podStartSLOduration=1.698269567 podStartE2EDuration="1.698269567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:32:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:32:08.697329931 +0000 UTC m=+1803.422932247" watchObservedRunningTime="2026-06-10 01:32:08.698269567 +0000 UTC m=+1803.423871883" Jun 10 01:32:19.687265 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:32:19.687230 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w2k7x" Jun 10 01:37:05.910266 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:37:05.910236 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:37:05.914578 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:37:05.914557 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:37:05.915116 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:37:05.915099 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:37:05.919227 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:37:05.919208 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:37:05.920863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:37:05.920837 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:37:05.924935 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:37:05.924918 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:41:36.850799 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.850754 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq"] Jun 10 01:41:36.854980 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.854957 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.858367 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.858229 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-597e3e56-openshift-default-dockercfg-d5mjg\"" Jun 10 01:41:36.874805 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.874774 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq"] Jun 10 01:41:36.935651 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935615 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqvg5\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-kube-api-access-mqvg5\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935828 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935662 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-data\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935828 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935691 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-certs\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935828 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935775 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-socket\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935828 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935808 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-credential-socket\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935997 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935830 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-podinfo\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935997 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935891 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-envoy\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935997 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935921 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-token\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:36.935997 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:36.935943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istiod-ca-cert\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.036613 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.036575 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-envoy\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.036779 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.036622 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-token\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.036779 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.036656 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istiod-ca-cert\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.036962 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.036937 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqvg5\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-kube-api-access-mqvg5\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037021 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037003 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-data\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037106 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037056 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-certs\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037171 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037105 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-socket\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037171 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037133 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-credential-socket\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037171 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037164 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-podinfo\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037365 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037339 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-data\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037503 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037474 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istiod-ca-cert\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037565 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037536 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-socket\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037627 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037609 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-credential-socket\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.037730 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.037714 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-certs\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.039510 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.039481 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-podinfo\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.039956 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.039934 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-envoy\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.046832 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.046811 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-token\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.046985 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.046968 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqvg5\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-kube-api-access-mqvg5\") pod \"e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.165341 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.165313 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:37.342438 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.342376 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq"] Jun 10 01:41:37.344804 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:41:37.344770 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cbdad3c_675a_4d5d_8750_0ca4094b5a11.slice/crio-993cf555f9cef9049cfd337e9a8d6c69fed632c6576b48174d3088447ce88c4b WatchSource:0}: Error finding container 993cf555f9cef9049cfd337e9a8d6c69fed632c6576b48174d3088447ce88c4b: Status 404 returned error can't find the container with id 993cf555f9cef9049cfd337e9a8d6c69fed632c6576b48174d3088447ce88c4b Jun 10 01:41:37.347108 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.347049 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:41:37.347212 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.347158 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:41:37.347212 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.347189 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:41:37.401885 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:37.401847 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" event={"ID":"1cbdad3c-675a-4d5d-8750-0ca4094b5a11","Type":"ContainerStarted","Data":"993cf555f9cef9049cfd337e9a8d6c69fed632c6576b48174d3088447ce88c4b"} Jun 10 01:41:38.410737 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:38.410698 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" event={"ID":"1cbdad3c-675a-4d5d-8750-0ca4094b5a11","Type":"ContainerStarted","Data":"8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203"} Jun 10 01:41:38.431358 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:38.431299 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" podStartSLOduration=2.431279506 podStartE2EDuration="2.431279506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:41:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:41:38.430494239 +0000 UTC m=+2373.156096557" watchObservedRunningTime="2026-06-10 01:41:38.431279506 +0000 UTC m=+2373.156881823" Jun 10 01:41:39.166275 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:39.166232 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:39.171874 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:39.171846 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:39.415414 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:39.415384 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:39.472170 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:39.472051 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:43.267311 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:43.267270 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq"] Jun 10 01:41:43.267800 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:43.267492 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" podUID="1cbdad3c-675a-4d5d-8750-0ca4094b5a11" containerName="istio-proxy" containerID="cri-o://8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203" gracePeriod=30 Jun 10 01:41:46.426532 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.426503 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:46.450913 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.450876 2554 generic.go:356] "Generic (PLEG): container finished" podID="1cbdad3c-675a-4d5d-8750-0ca4094b5a11" containerID="8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203" exitCode=0 Jun 10 01:41:46.451127 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.450945 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" Jun 10 01:41:46.451127 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.450958 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" event={"ID":"1cbdad3c-675a-4d5d-8750-0ca4094b5a11","Type":"ContainerDied","Data":"8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203"} Jun 10 01:41:46.451127 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.451015 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq" event={"ID":"1cbdad3c-675a-4d5d-8750-0ca4094b5a11","Type":"ContainerDied","Data":"993cf555f9cef9049cfd337e9a8d6c69fed632c6576b48174d3088447ce88c4b"} Jun 10 01:41:46.451127 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.451040 2554 scope.go:117] "RemoveContainer" containerID="8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203" Jun 10 01:41:46.459872 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.459848 2554 scope.go:117] "RemoveContainer" containerID="8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203" Jun 10 01:41:46.460186 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:41:46.460160 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203\": container with ID starting with 8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203 not found: ID does not exist" containerID="8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203" Jun 10 01:41:46.460263 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.460195 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203"} err="failed to get container status \"8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203\": rpc error: code = NotFound desc = could not find container \"8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203\": container with ID starting with 8bf505ec29d918ff5a1506b51d4601e35cbc89b6fde3a9e95f62ae27ce7f4203 not found: ID does not exist" Jun 10 01:41:46.534370 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534270 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-envoy\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534370 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534334 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-data\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534376 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-credential-socket\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534411 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-socket\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534444 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqvg5\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-kube-api-access-mqvg5\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534468 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istiod-ca-cert\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534493 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-podinfo\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534540 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-token\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534891 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534606 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-certs\") pod \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\" (UID: \"1cbdad3c-675a-4d5d-8750-0ca4094b5a11\") " Jun 10 01:41:46.534891 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534729 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:46.535050 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534929 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:41:46.535050 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.534985 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-credential-socket\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.535151 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.535128 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-data" (OuterVolumeSpecName: "istio-data") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:46.535228 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.535207 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:46.535471 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.535445 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:46.536710 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.536685 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:46.536832 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.536814 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-kube-api-access-mqvg5" (OuterVolumeSpecName: "kube-api-access-mqvg5") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "kube-api-access-mqvg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:41:46.537104 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.537052 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-token" (OuterVolumeSpecName: "istio-token") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:41:46.537190 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.537130 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1cbdad3c-675a-4d5d-8750-0ca4094b5a11" (UID: "1cbdad3c-675a-4d5d-8750-0ca4094b5a11"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 01:41:46.635617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635579 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-certs\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635611 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-envoy\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635620 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-data\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635629 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-workload-socket\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635637 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqvg5\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-kube-api-access-mqvg5\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635647 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istiod-ca-cert\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635655 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-podinfo\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.635890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.635663 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1cbdad3c-675a-4d5d-8750-0ca4094b5a11-istio-token\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:46.774925 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.774892 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq"] Jun 10 01:41:46.781165 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:46.781136 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-597e3e56-openshift-default-6bf87b5544-gnlwq"] Jun 10 01:41:47.818084 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:47.818049 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cbdad3c-675a-4d5d-8750-0ca4094b5a11" path="/var/lib/kubelet/pods/1cbdad3c-675a-4d5d-8750-0ca4094b5a11/volumes" Jun 10 01:41:49.179592 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.179557 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5"] Jun 10 01:41:49.180167 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.180147 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cbdad3c-675a-4d5d-8750-0ca4094b5a11" containerName="istio-proxy" Jun 10 01:41:49.180263 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.180170 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cbdad3c-675a-4d5d-8750-0ca4094b5a11" containerName="istio-proxy" Jun 10 01:41:49.180323 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.180265 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cbdad3c-675a-4d5d-8750-0ca4094b5a11" containerName="istio-proxy" Jun 10 01:41:49.183638 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.183615 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.186025 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.186004 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5ced4320-openshift-default-dockercfg-bc4l9\"" Jun 10 01:41:49.195727 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.195700 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5"] Jun 10 01:41:49.261977 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.261918 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bd2997c-77c6-4309-bcca-3e6289c79f91-istiod-ca-cert\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262003 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qzsd\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-kube-api-access-2qzsd\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-envoy\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262061 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-socket\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262117 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-credential-socket\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262139 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-podinfo\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262206 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262157 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-data\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262497 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262254 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-certs\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.262497 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.262305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-token\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363407 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363365 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qzsd\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-kube-api-access-2qzsd\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363425 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-envoy\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363467 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-socket\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-credential-socket\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363521 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-podinfo\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363600 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363553 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-data\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363629 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-certs\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363684 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-token\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.363863 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363774 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bd2997c-77c6-4309-bcca-3e6289c79f91-istiod-ca-cert\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.364029 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.363956 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-credential-socket\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.364108 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.364049 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-data\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.364342 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.364315 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-socket\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.364440 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.364409 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-certs\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.364657 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.364637 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bd2997c-77c6-4309-bcca-3e6289c79f91-istiod-ca-cert\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.366356 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.366329 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-envoy\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.366527 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.366509 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-podinfo\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.381582 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.381548 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qzsd\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-kube-api-access-2qzsd\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.381737 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.381715 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-token\") pod \"e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.445745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.445656 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994"] Jun 10 01:41:49.449125 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.449106 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.459302 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.459273 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994"] Jun 10 01:41:49.497932 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.497898 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:49.566825 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.566388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08a6685-11d9-4bf2-a107-0ac2d2588ecd-maas-api-tls\") pod \"maas-api-e2e-ait-5ced4320-666bd5598d-4d994\" (UID: \"a08a6685-11d9-4bf2-a107-0ac2d2588ecd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.566825 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.566457 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgpt\" (UniqueName: \"kubernetes.io/projected/a08a6685-11d9-4bf2-a107-0ac2d2588ecd-kube-api-access-4sgpt\") pod \"maas-api-e2e-ait-5ced4320-666bd5598d-4d994\" (UID: \"a08a6685-11d9-4bf2-a107-0ac2d2588ecd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.646921 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.646896 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5"] Jun 10 01:41:49.649029 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:41:49.648983 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bd2997c_77c6_4309_bcca_3e6289c79f91.slice/crio-f837088cc25a1742e01b45c1a23a64b7aeed73acdeabf939bc51f8853a99685e WatchSource:0}: Error finding container f837088cc25a1742e01b45c1a23a64b7aeed73acdeabf939bc51f8853a99685e: Status 404 returned error can't find the container with id f837088cc25a1742e01b45c1a23a64b7aeed73acdeabf939bc51f8853a99685e Jun 10 01:41:49.651195 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.651155 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:41:49.651299 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.651223 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:41:49.651299 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.651257 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jun 10 01:41:49.668198 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.668173 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08a6685-11d9-4bf2-a107-0ac2d2588ecd-maas-api-tls\") pod \"maas-api-e2e-ait-5ced4320-666bd5598d-4d994\" (UID: \"a08a6685-11d9-4bf2-a107-0ac2d2588ecd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.668307 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.668214 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgpt\" (UniqueName: \"kubernetes.io/projected/a08a6685-11d9-4bf2-a107-0ac2d2588ecd-kube-api-access-4sgpt\") pod \"maas-api-e2e-ait-5ced4320-666bd5598d-4d994\" (UID: \"a08a6685-11d9-4bf2-a107-0ac2d2588ecd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.670426 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.670401 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a08a6685-11d9-4bf2-a107-0ac2d2588ecd-maas-api-tls\") pod \"maas-api-e2e-ait-5ced4320-666bd5598d-4d994\" (UID: \"a08a6685-11d9-4bf2-a107-0ac2d2588ecd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.677764 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.677744 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgpt\" (UniqueName: \"kubernetes.io/projected/a08a6685-11d9-4bf2-a107-0ac2d2588ecd-kube-api-access-4sgpt\") pod \"maas-api-e2e-ait-5ced4320-666bd5598d-4d994\" (UID: \"a08a6685-11d9-4bf2-a107-0ac2d2588ecd\") " pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.761604 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.761571 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:49.938135 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.938101 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994"] Jun 10 01:41:49.939338 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:41:49.939307 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda08a6685_11d9_4bf2_a107_0ac2d2588ecd.slice/crio-e51b8a0366870d3e1795c4289c4657424bda082d68e60892e3e81612d6ca55a9 WatchSource:0}: Error finding container e51b8a0366870d3e1795c4289c4657424bda082d68e60892e3e81612d6ca55a9: Status 404 returned error can't find the container with id e51b8a0366870d3e1795c4289c4657424bda082d68e60892e3e81612d6ca55a9 Jun 10 01:41:49.940636 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:49.940619 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 01:41:50.477090 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.477033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" event={"ID":"a08a6685-11d9-4bf2-a107-0ac2d2588ecd","Type":"ContainerStarted","Data":"f415389c99a91380487bb0b64176f3bc377059c84840fefa1867b3e4a74211c6"} Jun 10 01:41:50.477559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.477116 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" event={"ID":"a08a6685-11d9-4bf2-a107-0ac2d2588ecd","Type":"ContainerStarted","Data":"e51b8a0366870d3e1795c4289c4657424bda082d68e60892e3e81612d6ca55a9"} Jun 10 01:41:50.477559 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.477149 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:50.478742 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.478712 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" event={"ID":"4bd2997c-77c6-4309-bcca-3e6289c79f91","Type":"ContainerStarted","Data":"d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0"} Jun 10 01:41:50.478875 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.478761 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" event={"ID":"4bd2997c-77c6-4309-bcca-3e6289c79f91","Type":"ContainerStarted","Data":"f837088cc25a1742e01b45c1a23a64b7aeed73acdeabf939bc51f8853a99685e"} Jun 10 01:41:50.493595 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.493532 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podStartSLOduration=1.141684812 podStartE2EDuration="1.493512733s" totalImagesPullingTime="351.827921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:41:50.491438698 +0000 UTC m=+2385.217041047" watchObservedRunningTime="2026-06-10 01:41:50.493512733 +0000 UTC m=+2385.219115051" Jun 10 01:41:50.498323 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.498286 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:50.503690 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.503668 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:50.509502 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:50.509459 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" podStartSLOduration=1.5094438989999999 podStartE2EDuration="1.509443899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 01:41:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:41:50.507972846 +0000 UTC m=+2385.233575189" watchObservedRunningTime="2026-06-10 01:41:50.509443899 +0000 UTC m=+2385.235046215" Jun 10 01:41:51.486107 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:51.486060 2554 generic.go:356] "Generic (PLEG): container finished" podID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" containerID="f415389c99a91380487bb0b64176f3bc377059c84840fefa1867b3e4a74211c6" exitCode=1 Jun 10 01:41:51.486584 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:51.486156 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" event={"ID":"a08a6685-11d9-4bf2-a107-0ac2d2588ecd","Type":"ContainerDied","Data":"f415389c99a91380487bb0b64176f3bc377059c84840fefa1867b3e4a74211c6"} Jun 10 01:41:51.486584 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:51.486434 2554 scope.go:117] "RemoveContainer" containerID="f415389c99a91380487bb0b64176f3bc377059c84840fefa1867b3e4a74211c6" Jun 10 01:41:51.486584 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:51.486545 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:51.487743 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:51.487726 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:52.497325 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:52.496521 2554 generic.go:356] "Generic (PLEG): container finished" podID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" exitCode=1 Jun 10 01:41:52.497325 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:52.497196 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" event={"ID":"a08a6685-11d9-4bf2-a107-0ac2d2588ecd","Type":"ContainerDied","Data":"b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112"} Jun 10 01:41:52.497325 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:52.497276 2554 scope.go:117] "RemoveContainer" containerID="f415389c99a91380487bb0b64176f3bc377059c84840fefa1867b3e4a74211c6" Jun 10 01:41:52.497899 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:52.497495 2554 scope.go:117] "RemoveContainer" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" Jun 10 01:41:52.497899 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:41:52.497732 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:41:53.502623 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:53.502590 2554 scope.go:117] "RemoveContainer" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" Jun 10 01:41:53.503094 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:41:53.502778 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:41:55.483111 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:55.482181 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:55.483111 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:55.482731 2554 scope.go:117] "RemoveContainer" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" Jun 10 01:41:55.483111 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:41:55.482969 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:41:56.587888 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:56.587847 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5"] Jun 10 01:41:56.588388 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:56.588106 2554 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" podUID="4bd2997c-77c6-4309-bcca-3e6289c79f91" containerName="istio-proxy" containerID="cri-o://d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0" gracePeriod=30 Jun 10 01:41:58.748930 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.748906 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:58.765932 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.765838 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bd2997c-77c6-4309-bcca-3e6289c79f91-istiod-ca-cert\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.765932 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.765879 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-envoy\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.765932 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.765903 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-token\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766250 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.765963 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-credential-socket\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766250 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766028 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-socket\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766250 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766051 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-data\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766250 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766114 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-certs\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766250 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766227 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qzsd\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-kube-api-access-2qzsd\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766512 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766299 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-podinfo\") pod \"4bd2997c-77c6-4309-bcca-3e6289c79f91\" (UID: \"4bd2997c-77c6-4309-bcca-3e6289c79f91\") " Jun 10 01:41:58.766512 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766390 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:58.766512 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766412 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bd2997c-77c6-4309-bcca-3e6289c79f91-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 01:41:58.766743 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766718 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bd2997c-77c6-4309-bcca-3e6289c79f91-istiod-ca-cert\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.766743 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766732 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:58.766986 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766741 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-credential-socket\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.766986 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.766859 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:58.767609 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.767529 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:58.769052 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.769029 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 01:41:58.769667 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.769639 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 01:41:58.769910 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.769886 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:41:58.770024 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.769915 2554 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-kube-api-access-2qzsd" (OuterVolumeSpecName: "kube-api-access-2qzsd") pod "4bd2997c-77c6-4309-bcca-3e6289c79f91" (UID: "4bd2997c-77c6-4309-bcca-3e6289c79f91"). InnerVolumeSpecName "kube-api-access-2qzsd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 01:41:58.868205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868174 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-socket\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.868205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868200 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-data\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.868205 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868211 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-workload-certs\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.868419 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868220 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qzsd\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-kube-api-access-2qzsd\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.868419 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868230 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-podinfo\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.868419 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868239 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-envoy\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:58.868419 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:58.868246 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bd2997c-77c6-4309-bcca-3e6289c79f91-istio-token\") on node \"ip-10-0-142-1.ec2.internal\" DevicePath \"\"" Jun 10 01:41:59.536265 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.536231 2554 generic.go:356] "Generic (PLEG): container finished" podID="4bd2997c-77c6-4309-bcca-3e6289c79f91" containerID="d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0" exitCode=0 Jun 10 01:41:59.536466 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.536281 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" Jun 10 01:41:59.536466 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.536318 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" event={"ID":"4bd2997c-77c6-4309-bcca-3e6289c79f91","Type":"ContainerDied","Data":"d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0"} Jun 10 01:41:59.536466 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.536382 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5" event={"ID":"4bd2997c-77c6-4309-bcca-3e6289c79f91","Type":"ContainerDied","Data":"f837088cc25a1742e01b45c1a23a64b7aeed73acdeabf939bc51f8853a99685e"} Jun 10 01:41:59.536466 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.536412 2554 scope.go:117] "RemoveContainer" containerID="d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0" Jun 10 01:41:59.552313 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.552292 2554 scope.go:117] "RemoveContainer" containerID="d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0" Jun 10 01:41:59.552600 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:41:59.552579 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0\": container with ID starting with d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0 not found: ID does not exist" containerID="d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0" Jun 10 01:41:59.552669 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.552607 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0"} err="failed to get container status \"d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0\": rpc error: code = NotFound desc = could not find container \"d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0\": container with ID starting with d6e5f26deb6de2321f85ca297ce26eb4e639d4ce3b6674f900b057c737a31fc0 not found: ID does not exist" Jun 10 01:41:59.562010 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.561987 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5"] Jun 10 01:41:59.565843 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.565823 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5ced4320-openshift-default-985874dbb-rw9q5"] Jun 10 01:41:59.761748 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.761710 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:41:59.762202 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.762185 2554 scope.go:117] "RemoveContainer" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" Jun 10 01:41:59.762381 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:41:59.762362 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:41:59.823421 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:41:59.823385 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bd2997c-77c6-4309-bcca-3e6289c79f91" path="/var/lib/kubelet/pods/4bd2997c-77c6-4309-bcca-3e6289c79f91/volumes" Jun 10 01:42:05.945064 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:05.945036 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:42:05.948335 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:05.948312 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:42:05.949819 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:05.949799 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:42:05.953049 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:05.953020 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:42:05.955627 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:05.955605 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:42:05.958679 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:05.958662 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-acl-logging/0.log" Jun 10 01:42:11.811619 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:11.811586 2554 scope.go:117] "RemoveContainer" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" Jun 10 01:42:12.601237 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:12.601202 2554 generic.go:356] "Generic (PLEG): container finished" podID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" containerID="b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b" exitCode=1 Jun 10 01:42:12.601421 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:12.601254 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" event={"ID":"a08a6685-11d9-4bf2-a107-0ac2d2588ecd","Type":"ContainerDied","Data":"b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b"} Jun 10 01:42:12.601421 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:12.601329 2554 scope.go:117] "RemoveContainer" containerID="b65cc911f6adc3a8ef0e60944ac030fb905af98c1352b927fc73e4ea9450f112" Jun 10 01:42:12.601697 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:12.601670 2554 scope.go:117] "RemoveContainer" containerID="b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b" Jun 10 01:42:12.601896 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:12.601874 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:14.270186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:14.270156 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-c8c9c9665-z7sfr_1deafc60-b757-4fde-b94b-dae7ae79b004/nginx/0.log" Jun 10 01:42:14.604137 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:14.604053 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59dd9cb567-dm7qr_7ef89a8a-74c4-452a-a470-e8597688442d/manager/0.log" Jun 10 01:42:15.183720 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:15.183689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-s5ffn_86935439-8ca2-4f10-82dc-0e3117cd3552/copy-manifests/0.log" Jun 10 01:42:15.190037 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:15.190005 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-s5ffn_86935439-8ca2-4f10-82dc-0e3117cd3552/manager/0.log" Jun 10 01:42:15.478234 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:15.478145 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:42:15.478610 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:15.478523 2554 scope.go:117] "RemoveContainer" containerID="b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b" Jun 10 01:42:15.478707 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:15.478688 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:16.536656 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:16.536625 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fdzhs_50eb9c0c-7924-4bd7-9993-08ffbeae7b63/manager/0.log" Jun 10 01:42:16.863999 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:16.863913 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4wmnd_1d912d12-8303-4077-8d32-5c9e559bac69/registry-server/0.log" Jun 10 01:42:16.981039 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:16.980980 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w2k7x_55200bc4-f4f7-42e7-ae9d-8bb581a8061f/manager/0.log" Jun 10 01:42:17.552320 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:17.552283 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcxn9sv_87b53f92-64ef-4ecd-9f04-c9b348704f0a/istio-proxy/0.log" Jun 10 01:42:18.010294 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.010259 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/1.log" Jun 10 01:42:18.120189 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.120154 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-kf7jz_53b58a45-3530-4363-a06c-f0e5fe7fb718/payload-pre-processing/0.log" Jun 10 01:42:18.231617 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.231586 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6z96s_7e8fbf0c-eb76-4198-ab00-b68decc3a2a2/payload-processing/0.log" Jun 10 01:42:18.337707 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.337630 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dd4c555c-j4dsf_deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3/router/0.log" Jun 10 01:42:18.675781 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.675756 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v_fdea62ce-9aef-40d4-b7b1-547daa1d6ceb/storage-initializer/0.log" Jun 10 01:42:18.682523 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.682504 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-5s49v_fdea62ce-9aef-40d4-b7b1-547daa1d6ceb/main/0.log" Jun 10 01:42:18.791580 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.791541 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-hf7vc_a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7/storage-initializer/0.log" Jun 10 01:42:18.799778 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:18.799751 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-hf7vc_a99caf5a-e4cd-4e07-8e6d-cf1987d03ec7/main/0.log" Jun 10 01:42:19.029024 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:19.028929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz_b81c0684-927e-4f37-b6dc-ca770edb9910/storage-initializer/0.log" Jun 10 01:42:19.035688 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:19.035657 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c65rkz_b81c0684-927e-4f37-b6dc-ca770edb9910/main/0.log" Jun 10 01:42:19.762235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:19.762189 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:42:19.762623 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:19.762614 2554 scope.go:117] "RemoveContainer" containerID="b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b" Jun 10 01:42:19.762797 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:19.762779 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:26.624388 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:26.624304 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9n2dh_61690ee4-93d0-424d-b3aa-92962ffcebb6/global-pull-secret-syncer/0.log" Jun 10 01:42:26.826353 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:26.826322 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xxzpx_921cf87a-a947-4670-94a0-af969c870dce/konnectivity-agent/0.log" Jun 10 01:42:26.869958 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:26.869928 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-1.ec2.internal_7c77efe5dbb10bf49d407d2dcd67c5a4/haproxy/0.log" Jun 10 01:42:32.182208 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:32.182175 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-fdzhs_50eb9c0c-7924-4bd7-9993-08ffbeae7b63/manager/0.log" Jun 10 01:42:32.270379 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:32.270299 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4wmnd_1d912d12-8303-4077-8d32-5c9e559bac69/registry-server/0.log" Jun 10 01:42:32.327658 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:32.327627 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-w2k7x_55200bc4-f4f7-42e7-ae9d-8bb581a8061f/manager/0.log" Jun 10 01:42:33.812318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:33.812286 2554 scope.go:117] "RemoveContainer" containerID="b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b" Jun 10 01:42:34.515923 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.515896 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpzkz_7636b318-1ff2-4d47-aaf3-9540bf0ff990/node-exporter/0.log" Jun 10 01:42:34.556385 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.556362 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpzkz_7636b318-1ff2-4d47-aaf3-9540bf0ff990/kube-rbac-proxy/0.log" Jun 10 01:42:34.579725 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.579702 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mpzkz_7636b318-1ff2-4d47-aaf3-9540bf0ff990/init-textfile/0.log" Jun 10 01:42:34.696690 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.696664 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/0.log" Jun 10 01:42:34.697406 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.697389 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/prometheus/1.log" Jun 10 01:42:34.713133 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.713107 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/config-reloader/0.log" Jun 10 01:42:34.715992 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.715969 2554 generic.go:356] "Generic (PLEG): container finished" podID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" containerID="b0cc61d055eedc0ffffe0040a164c742cfcf23d43824a29099ca1e9886edae9e" exitCode=1 Jun 10 01:42:34.716132 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.716032 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" event={"ID":"a08a6685-11d9-4bf2-a107-0ac2d2588ecd","Type":"ContainerDied","Data":"b0cc61d055eedc0ffffe0040a164c742cfcf23d43824a29099ca1e9886edae9e"} Jun 10 01:42:34.716132 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.716116 2554 scope.go:117] "RemoveContainer" containerID="b68595efa264eb74edae9b31011542a31dc3f237064dceb341ab6c56d971e63b" Jun 10 01:42:34.716496 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.716478 2554 scope.go:117] "RemoveContainer" containerID="b0cc61d055eedc0ffffe0040a164c742cfcf23d43824a29099ca1e9886edae9e" Jun 10 01:42:34.716702 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:34.716683 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:34.738770 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.738718 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/thanos-sidecar/0.log" Jun 10 01:42:34.759510 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.759483 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/kube-rbac-proxy-web/0.log" Jun 10 01:42:34.781072 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.781045 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/kube-rbac-proxy/0.log" Jun 10 01:42:34.801274 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.801253 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/kube-rbac-proxy-thanos/0.log" Jun 10 01:42:34.824105 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:34.824065 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_463dc17c-ef5b-4b82-baea-a8320a88a335/init-config-reloader/0.log" Jun 10 01:42:35.477328 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:35.477291 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:42:35.722525 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:35.722501 2554 scope.go:117] "RemoveContainer" containerID="b0cc61d055eedc0ffffe0040a164c742cfcf23d43824a29099ca1e9886edae9e" Jun 10 01:42:35.722700 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:35.722679 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:37.381864 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:37.381828 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/2.log" Jun 10 01:42:37.386141 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:37.386117 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-mnnbc_06081cb6-3657-4e88-a062-ae05eac02ca0/console-operator/3.log" Jun 10 01:42:38.986829 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.986787 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj"] Jun 10 01:42:38.987357 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.987328 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bd2997c-77c6-4309-bcca-3e6289c79f91" containerName="istio-proxy" Jun 10 01:42:38.987357 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.987355 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bd2997c-77c6-4309-bcca-3e6289c79f91" containerName="istio-proxy" Jun 10 01:42:38.987592 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.987446 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bd2997c-77c6-4309-bcca-3e6289c79f91" containerName="istio-proxy" Jun 10 01:42:38.990831 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.990812 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:38.993041 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.993007 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kdsff\"/\"openshift-service-ca.crt\"" Jun 10 01:42:38.993168 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.993100 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kdsff\"/\"kube-root-ca.crt\"" Jun 10 01:42:38.993168 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.993122 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kdsff\"/\"default-dockercfg-zj2n9\"" Jun 10 01:42:38.998702 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:38.998677 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj"] Jun 10 01:42:39.036035 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.035995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s55bg\" (UniqueName: \"kubernetes.io/projected/d0e2ed70-7331-4c1f-9155-608d66de0e5b-kube-api-access-s55bg\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.036242 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.036059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-podres\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.036242 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.036106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-sys\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.036242 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.036124 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-proc\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.036242 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.036181 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-lib-modules\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136703 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136664 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-podres\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136703 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136705 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-sys\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-proc\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136783 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-proc\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136798 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-sys\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136807 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-podres\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136832 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-lib-modules\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136945 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d0e2ed70-7331-4c1f-9155-608d66de0e5b-lib-modules\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.136972 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.136960 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s55bg\" (UniqueName: \"kubernetes.io/projected/d0e2ed70-7331-4c1f-9155-608d66de0e5b-kube-api-access-s55bg\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.144318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.144293 2554 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s55bg\" (UniqueName: \"kubernetes.io/projected/d0e2ed70-7331-4c1f-9155-608d66de0e5b-kube-api-access-s55bg\") pod \"perf-node-gather-daemonset-hj2xj\" (UID: \"d0e2ed70-7331-4c1f-9155-608d66de0e5b\") " pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.301503 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.301419 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.431621 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.431595 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj"] Jun 10 01:42:39.433635 ip-10-0-142-1 kubenswrapper[2554]: W0610 01:42:39.433609 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd0e2ed70_7331_4c1f_9155_608d66de0e5b.slice/crio-2c41d466c4680fa29b27c679a60401d3877d426150f99f98e2bdaf3166c47aa2 WatchSource:0}: Error finding container 2c41d466c4680fa29b27c679a60401d3877d426150f99f98e2bdaf3166c47aa2: Status 404 returned error can't find the container with id 2c41d466c4680fa29b27c679a60401d3877d426150f99f98e2bdaf3166c47aa2 Jun 10 01:42:39.744052 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.744014 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" event={"ID":"d0e2ed70-7331-4c1f-9155-608d66de0e5b","Type":"ContainerStarted","Data":"c118a1342ec7b3a82b0e9d50d1c05c6417c23177e4a839617d69a086ab90ab3a"} Jun 10 01:42:39.744262 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.744102 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" event={"ID":"d0e2ed70-7331-4c1f-9155-608d66de0e5b","Type":"ContainerStarted","Data":"2c41d466c4680fa29b27c679a60401d3877d426150f99f98e2bdaf3166c47aa2"} Jun 10 01:42:39.744262 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.744132 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:39.758173 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.758122 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" podStartSLOduration=1.758107294 podStartE2EDuration="1.758107294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 01:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 01:42:39.757253434 +0000 UTC m=+2434.482855776" watchObservedRunningTime="2026-06-10 01:42:39.758107294 +0000 UTC m=+2434.483709611" Jun 10 01:42:39.762332 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.762311 2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" Jun 10 01:42:39.762692 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.762677 2554 scope.go:117] "RemoveContainer" containerID="b0cc61d055eedc0ffffe0040a164c742cfcf23d43824a29099ca1e9886edae9e" Jun 10 01:42:39.762868 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:39.762849 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:39.955768 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.955732 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6j5k_aef9794f-16e4-49f4-9942-992cdf29dcb5/dns/0.log" Jun 10 01:42:39.976186 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:39.976162 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6j5k_aef9794f-16e4-49f4-9942-992cdf29dcb5/kube-rbac-proxy/0.log" Jun 10 01:42:40.094612 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:40.094521 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2ps6g_7b0f4ee2-8241-47aa-9e9f-e47769fa3cee/dns-node-resolver/0.log" Jun 10 01:42:40.679321 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:40.679281 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7999d85f4-m2t6k_2283b299-1e56-47b3-9fed-83ef34fcdb45/registry/0.log" Jun 10 01:42:40.686709 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:40.686691 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7999d85f4-m2t6k_2283b299-1e56-47b3-9fed-83ef34fcdb45/registry/1.log" Jun 10 01:42:40.706286 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:40.706265 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2tpq7_47ff70a7-107b-4b1d-a602-11b1b3dd6050/node-ca/0.log" Jun 10 01:42:41.739153 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:41.739124 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcxn9sv_87b53f92-64ef-4ecd-9f04-c9b348704f0a/istio-proxy/0.log" Jun 10 01:42:41.965294 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:41.965262 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/0.log" Jun 10 01:42:41.995951 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:41.995850 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/1.log" Jun 10 01:42:42.033235 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:42.033201 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-kf7jz_53b58a45-3530-4363-a06c-f0e5fe7fb718/payload-pre-processing/0.log" Jun 10 01:42:42.094745 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:42.094716 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6z96s_7e8fbf0c-eb76-4198-ab00-b68decc3a2a2/payload-processing/0.log" Jun 10 01:42:42.116429 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:42.116405 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dd4c555c-j4dsf_deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3/router/0.log" Jun 10 01:42:42.736470 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:42.736439 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6g2wj_6e1ba28c-a48d-471b-877f-289a45e7e43c/serve-healthcheck-canary/0.log" Jun 10 01:42:43.378318 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:43.378287 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqcjz_4eea8960-304c-429f-b2c1-ddf57191de4a/kube-rbac-proxy/0.log" Jun 10 01:42:43.398487 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:43.398461 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqcjz_4eea8960-304c-429f-b2c1-ddf57191de4a/exporter/0.log" Jun 10 01:42:43.418416 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:43.418383 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mqcjz_4eea8960-304c-429f-b2c1-ddf57191de4a/extractor/0.log" Jun 10 01:42:45.681203 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:45.681171 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-c8c9c9665-z7sfr_1deafc60-b757-4fde-b94b-dae7ae79b004/nginx/0.log" Jun 10 01:42:45.758176 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:45.758147 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kdsff/perf-node-gather-daemonset-hj2xj" Jun 10 01:42:45.937271 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:45.937179 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59dd9cb567-dm7qr_7ef89a8a-74c4-452a-a470-e8597688442d/manager/0.log" Jun 10 01:42:46.260054 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:46.259956 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-s5ffn_86935439-8ca2-4f10-82dc-0e3117cd3552/manager/0.log" Jun 10 01:42:46.281732 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:46.281707 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f47d5f68-s5ffn_86935439-8ca2-4f10-82dc-0e3117cd3552/copy-manifests/0.log" Jun 10 01:42:47.825392 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:47.825351 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67d5b6d8d5-5tmqz_748beac8-2722-42ab-be7c-b8a23ec50eb6/manager/0.log" Jun 10 01:42:52.369621 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:52.369589 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcxn9sv_87b53f92-64ef-4ecd-9f04-c9b348704f0a/istio-proxy/0.log" Jun 10 01:42:52.528421 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:52.528382 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/0.log" Jun 10 01:42:52.558675 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:52.558642 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/1.log" Jun 10 01:42:52.590849 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:52.590819 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-kf7jz_53b58a45-3530-4363-a06c-f0e5fe7fb718/payload-pre-processing/0.log" Jun 10 01:42:52.641503 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:52.641476 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6z96s_7e8fbf0c-eb76-4198-ab00-b68decc3a2a2/payload-processing/0.log" Jun 10 01:42:52.652789 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:52.652766 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dd4c555c-j4dsf_deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3/router/0.log" Jun 10 01:42:53.347693 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:53.347663 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-2s4jb_d9bfaf8d-450d-4839-9db2-3c09ea7f36db/migrator/0.log" Jun 10 01:42:53.367482 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:53.367447 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-2s4jb_d9bfaf8d-450d-4839-9db2-3c09ea7f36db/graceful-termination/0.log" Jun 10 01:42:53.780071 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:53.780044 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcxn9sv_87b53f92-64ef-4ecd-9f04-c9b348704f0a/istio-proxy/0.log" Jun 10 01:42:53.925001 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:53.924970 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/0.log" Jun 10 01:42:53.959448 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:53.959422 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/1.log" Jun 10 01:42:53.991866 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:53.991833 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-kf7jz_53b58a45-3530-4363-a06c-f0e5fe7fb718/payload-pre-processing/0.log" Jun 10 01:42:54.044163 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:54.039383 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6z96s_7e8fbf0c-eb76-4198-ab00-b68decc3a2a2/payload-processing/0.log" Jun 10 01:42:54.053689 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:54.053662 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dd4c555c-j4dsf_deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3/router/0.log" Jun 10 01:42:54.811732 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:54.811700 2554 scope.go:117] "RemoveContainer" containerID="b0cc61d055eedc0ffffe0040a164c742cfcf23d43824a29099ca1e9886edae9e" Jun 10 01:42:54.812118 ip-10-0-142-1 kubenswrapper[2554]: E0610 01:42:54.811943 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-5ced4320-666bd5598d-4d994_redhat-ai-gateway-infra(a08a6685-11d9-4bf2-a107-0ac2d2588ecd)\"" pod="redhat-ai-gateway-infra/maas-api-e2e-ait-5ced4320-666bd5598d-4d994" podUID="a08a6685-11d9-4bf2-a107-0ac2d2588ecd" Jun 10 01:42:55.303400 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.303372 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/kube-multus-additional-cni-plugins/0.log" Jun 10 01:42:55.325464 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.325433 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/egress-router-binary-copy/0.log" Jun 10 01:42:55.346890 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.346859 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/cni-plugins/0.log" Jun 10 01:42:55.367715 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.367689 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/bond-cni-plugin/0.log" Jun 10 01:42:55.388651 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.388627 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/routeoverride-cni/0.log" Jun 10 01:42:55.409485 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.409458 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/whereabouts-cni-bincopy/0.log" Jun 10 01:42:55.431535 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.431503 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rmln5_7c8040b5-a04e-4bc9-95aa-c5e64c5425b4/whereabouts-cni/0.log" Jun 10 01:42:55.462396 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.462363 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-tkxfw_f3e75149-d033-4820-9b04-8d9f9c3a2614/kube-multus/0.log" Jun 10 01:42:55.614213 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.614132 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vbrdw_9a7de745-ffdf-4b32-a818-7c023c9a0633/network-metrics-daemon/0.log" Jun 10 01:42:55.635455 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.635426 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vbrdw_9a7de745-ffdf-4b32-a818-7c023c9a0633/kube-rbac-proxy/0.log" Jun 10 01:42:55.652341 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.652314 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcxn9sv_87b53f92-64ef-4ecd-9f04-c9b348704f0a/istio-proxy/0.log" Jun 10 01:42:55.803598 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.803571 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/0.log" Jun 10 01:42:55.835960 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.835929 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-n622k_83b26584-3d46-409c-b13d-b46b9fe675dd/istio-proxy/1.log" Jun 10 01:42:55.863638 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.863608 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-kf7jz_53b58a45-3530-4363-a06c-f0e5fe7fb718/payload-pre-processing/0.log" Jun 10 01:42:55.908341 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.908313 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-6z96s_7e8fbf0c-eb76-4198-ab00-b68decc3a2a2/payload-processing/0.log" Jun 10 01:42:55.926690 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:55.926666 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-67dd4c555c-j4dsf_deacd08b-8eb1-42ec-aa1f-d07a9ecab4c3/router/0.log" Jun 10 01:42:56.870233 ip-10-0-142-1 kubenswrapper[2554]: I0610 01:42:56.870203 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsl45_243fbb3f-7b42-4f46-ba8c-3ebfab6e90aa/ovn-controller/0.log"