Jun 03 23:24:42.067703 ip-10-0-131-117 systemd[1]: Starting Kubernetes Kubelet... Jun 03 23:24:42.490916 ip-10-0-131-117 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:42.490916 ip-10-0-131-117 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 03 23:24:42.490916 ip-10-0-131-117 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:42.490916 ip-10-0-131-117 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 03 23:24:42.490916 ip-10-0-131-117 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 03 23:24:42.492517 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.492431 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 03 23:24:42.498115 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498099 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:42.498115 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498115 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498119 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498122 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498125 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498128 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498131 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498135 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498138 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498140 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498143 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498146 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498148 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498152 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498154 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498157 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498160 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498162 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498166 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498171 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498174 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:42.498179 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498176 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498179 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498182 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498184 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498187 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498190 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498193 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498196 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498198 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498201 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498203 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498206 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498208 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498213 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498217 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498220 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498222 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498225 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498228 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498231 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:42.498662 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498234 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498237 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498240 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498243 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498245 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498248 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498251 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498254 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498258 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498261 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498263 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498266 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498269 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498272 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498275 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498278 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498281 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498285 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498288 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:42.499178 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498290 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498293 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498296 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498298 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498301 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498303 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498306 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498309 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498312 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498315 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498331 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498333 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498336 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498339 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498341 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498344 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498346 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498349 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498351 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498355 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:42.499668 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498357 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498360 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498362 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498365 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498367 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498370 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498372 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498375 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498378 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498381 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498383 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498386 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498388 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498391 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498393 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498396 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498398 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.498401 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499105 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499111 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:42.500162 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499115 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499118 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499121 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499124 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499126 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499128 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499131 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499135 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499137 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499140 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499142 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499146 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499148 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499152 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499155 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499157 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499160 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499162 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499165 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499168 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:42.500702 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499171 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499173 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499177 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499181 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499185 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499188 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499191 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499193 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499196 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499199 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499202 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499206 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499210 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499213 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499216 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499220 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499223 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499226 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499229 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:42.501228 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499232 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499234 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499237 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499239 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499242 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499245 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499247 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499250 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499252 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499255 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499257 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499260 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499263 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499266 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499268 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499271 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499273 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499276 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499278 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499281 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:42.501719 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499283 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499286 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499288 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499290 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499293 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499296 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499299 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499302 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499304 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499307 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499310 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499312 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499314 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499335 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499340 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499344 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499349 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499352 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499355 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499357 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:42.502209 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499360 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499362 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499365 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499368 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499371 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499373 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499376 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499378 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499381 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499383 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499386 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499388 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499391 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499393 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499395 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499398 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.499400 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500239 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500251 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500255 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:42.502711 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500258 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500263 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500267 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500271 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500276 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500279 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500282 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500285 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500287 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500290 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500293 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500296 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500299 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500301 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500304 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500307 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500309 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500312 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500314 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:42.503201 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500316 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500332 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500335 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500337 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500340 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500342 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500346 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500348 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500351 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500354 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500356 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500360 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500363 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500366 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500368 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500370 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500373 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500376 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500378 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500381 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:42.503685 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500383 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500386 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500388 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500391 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500393 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500396 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500398 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500401 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500403 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500406 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500408 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500411 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500413 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500416 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500418 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500421 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500423 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500426 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500428 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500431 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:42.504191 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500434 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500437 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500439 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500443 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500445 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500449 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500452 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500456 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500459 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500463 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500465 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500468 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500470 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500473 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500476 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500478 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500481 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500484 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500487 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:42.504733 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500489 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500491 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500494 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500497 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500499 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500501 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500504 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500506 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500509 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500511 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500514 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500517 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500519 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500522 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500525 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500528 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.500531 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500599 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500609 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500618 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500625 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 03 23:24:42.505194 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500632 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500635 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500639 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500644 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500647 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500650 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500653 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500657 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500659 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500662 2566 flags.go:64] FLAG: --cgroup-root="" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500665 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500669 2566 flags.go:64] FLAG: --client-ca-file="" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500672 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500674 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500678 2566 flags.go:64] FLAG: --cluster-domain="" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500680 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500683 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500687 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500690 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500693 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500696 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500699 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500702 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500706 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 03 23:24:42.505731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500709 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500712 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500716 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500719 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500723 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500727 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500729 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500732 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500735 2566 flags.go:64] FLAG: --enable-server="true" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500738 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500743 2566 flags.go:64] FLAG: --event-burst="100" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500745 2566 flags.go:64] FLAG: --event-qps="50" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500748 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500751 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500754 2566 flags.go:64] FLAG: --eviction-hard="" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500758 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500761 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500764 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500767 2566 flags.go:64] FLAG: --eviction-soft="" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500770 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500773 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500776 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500779 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500782 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500784 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 03 23:24:42.506307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500787 2566 flags.go:64] FLAG: --feature-gates="" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500790 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500793 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500796 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500800 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500802 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500805 2566 flags.go:64] FLAG: --help="false" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500808 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500811 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500815 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500818 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500822 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500825 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500828 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500831 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500834 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500836 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500839 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500842 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500844 2566 flags.go:64] FLAG: --kube-reserved="" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500847 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500850 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500853 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500855 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 03 23:24:42.507033 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500858 2566 flags.go:64] FLAG: --lock-file="" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500860 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500863 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500866 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500873 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500875 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500878 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500881 2566 flags.go:64] FLAG: --logging-format="text" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500884 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500887 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500890 2566 flags.go:64] FLAG: --manifest-url="" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500892 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500897 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500899 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500904 2566 flags.go:64] FLAG: --max-pods="110" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500906 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500909 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500913 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500916 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500919 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500922 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500925 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500931 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500934 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500937 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 03 23:24:42.507854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500941 2566 flags.go:64] FLAG: --pod-cidr="" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500944 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500948 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500951 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500955 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500957 2566 flags.go:64] FLAG: --port="10250" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500960 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500963 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f8f5c99fdf3764ec" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500967 2566 flags.go:64] FLAG: --qos-reserved="" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500970 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500973 2566 flags.go:64] FLAG: --register-node="true" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500976 2566 flags.go:64] FLAG: --register-with-taints="" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500979 2566 flags.go:64] FLAG: --registry-burst="10" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500982 2566 flags.go:64] FLAG: --registry-qps="5" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500984 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500987 2566 flags.go:64] FLAG: --reserved-memory="" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500991 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500993 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500996 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.500999 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501002 2566 flags.go:64] FLAG: --runonce="false" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501004 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501007 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501010 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501013 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 03 23:24:42.508981 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501015 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501019 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501022 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501025 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501027 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501030 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501033 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501035 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501038 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501041 2566 flags.go:64] FLAG: --system-cgroups="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501043 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501048 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501051 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501054 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501057 2566 flags.go:64] FLAG: --tls-min-version="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501060 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501065 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501068 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501071 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501073 2566 flags.go:64] FLAG: --v="2" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501077 2566 flags.go:64] FLAG: --version="false" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501081 2566 flags.go:64] FLAG: --vmodule="" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501089 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.501092 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501204 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:42.509693 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501208 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501212 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501215 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501218 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501221 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501224 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501227 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501229 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501232 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501235 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501238 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501241 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501244 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501248 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501252 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501255 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501257 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501260 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501263 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:42.510288 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501266 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501269 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501271 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501274 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501278 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501280 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501283 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501285 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501288 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501291 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501293 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501295 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501298 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501301 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501304 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501306 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501309 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501312 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501314 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501316 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:42.510789 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501333 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501335 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501338 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501341 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501344 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501346 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501349 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501351 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501354 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501357 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501359 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501362 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501364 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501366 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501369 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501371 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501375 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501378 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501382 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501385 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:42.511282 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501388 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501393 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501396 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501399 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501402 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501404 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501407 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501410 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501413 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501415 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501418 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501421 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501424 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501426 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501429 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501432 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501441 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501445 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501447 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501450 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:42.511782 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501452 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501455 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501457 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501460 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501463 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501465 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501467 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501470 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501474 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501476 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501479 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501481 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501484 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501487 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501490 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501492 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501495 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:42.512277 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.501497 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.502079 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.510451 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.510467 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.510486 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.510492 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510546 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510551 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510554 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510557 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510560 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510563 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510566 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510568 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510571 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:42.512763 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510574 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510577 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510580 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510583 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510586 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510589 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510591 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510594 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510597 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510599 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510602 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510604 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510606 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510609 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510611 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510614 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510616 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510619 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510621 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510625 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:42.513130 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510628 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510632 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510636 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510639 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510642 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510645 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510648 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510651 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510654 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510656 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510659 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510661 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510664 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510666 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510669 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510671 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510674 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510676 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510679 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510681 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:42.513639 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510684 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510686 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510689 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510691 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510694 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510696 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510698 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510701 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510704 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510706 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510708 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510711 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510715 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510717 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510720 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510723 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510725 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510728 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510730 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510733 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:42.514159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510735 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510738 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510741 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510743 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510746 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510748 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510751 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510755 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510758 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510760 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510763 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510766 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510769 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510771 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510775 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510778 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510781 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510783 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510786 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:42.514694 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510789 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510791 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510794 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510796 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510800 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510802 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510805 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510808 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510811 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510813 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.510819 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510930 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510935 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510939 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 03 23:24:42.515154 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510942 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510945 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510948 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510950 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510953 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510955 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510958 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510960 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510963 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510965 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510968 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510971 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510973 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510976 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510978 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510980 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510983 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510985 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510988 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510990 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 03 23:24:42.515572 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510993 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510995 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.510998 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511001 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511003 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511006 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511008 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511011 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511014 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511016 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511018 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511021 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511023 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511026 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511028 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511031 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511033 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511035 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511038 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511040 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 03 23:24:42.516119 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511043 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511045 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511048 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511050 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511053 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511055 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511058 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511060 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511063 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511065 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511068 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511070 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511073 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511075 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511077 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511080 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511083 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511086 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511088 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511091 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 03 23:24:42.516778 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511094 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511096 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511098 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511101 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511103 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511106 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511108 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511110 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511113 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511115 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511117 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511120 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511122 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511125 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511127 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511129 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511133 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511135 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511138 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511140 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 03 23:24:42.517346 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511142 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511145 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511147 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511149 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511152 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511155 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511157 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511160 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511163 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511165 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511169 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511172 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511175 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511179 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:42.511182 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 03 23:24:42.518159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.511187 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 03 23:24:42.518610 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.511286 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 03 23:24:42.518610 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.513695 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 03 23:24:42.518610 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.515383 2566 server.go:1019] "Starting client certificate rotation" Jun 03 23:24:42.518610 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.515506 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:24:42.518610 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.515556 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 03 23:24:42.518739 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.518682 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:24:42.522678 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.522660 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 03 23:24:42.538223 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.538201 2566 log.go:25] "Validated CRI v1 runtime API" Jun 03 23:24:42.541008 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.540995 2566 log.go:25] "Validated CRI v1 image API" Jun 03 23:24:42.541915 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.541894 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 03 23:24:42.544200 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.544184 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:24:42.544911 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.544891 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7a5cd57f-58af-4287-96ae-7c09bef8bf8f:/dev/nvme0n1p4 cb0aa5c1-a372-422c-9d4c-b74455f682d7:/dev/nvme0n1p3] Jun 03 23:24:42.545001 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.544911 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 03 23:24:42.550789 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.550677 2566 manager.go:216] Machine: {Timestamp:2026-06-03 23:24:42.549440275 +0000 UTC m=+0.358947448 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103354 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25e66b217e0d9a84a46da3a43ce83e SystemUUID:ec25e66b-217e-0d9a-84a4-6da3a43ce83e BootID:c06e35f5-d926-475a-b482-558b5c5d5644 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:51:3b:05:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:51:3b:05:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:3e:09:c0:e0:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 03 23:24:42.550789 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.550779 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 03 23:24:42.550925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.550850 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 03 23:24:42.553619 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.553593 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 03 23:24:42.553741 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.553621 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-117.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 03 23:24:42.554528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.554517 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 03 23:24:42.554567 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.554531 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 03 23:24:42.554567 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.554538 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:24:42.555306 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.555297 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 03 23:24:42.556085 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.556075 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 03 23:24:42.558797 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558786 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:24:42.558909 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558900 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 03 23:24:42.558937 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558929 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 03 23:24:42.558975 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558938 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 03 23:24:42.558975 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558951 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 03 23:24:42.558975 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558960 2566 kubelet.go:398] "Adding apiserver pod source" Jun 03 23:24:42.558975 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.558969 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 03 23:24:42.559298 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.559286 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:24:42.559362 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.559306 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 03 23:24:42.565460 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.565444 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 03 23:24:42.567101 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.567089 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 03 23:24:42.567148 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.567119 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 03 23:24:42.568135 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568123 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568140 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568146 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568151 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568163 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568170 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568178 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 03 23:24:42.568181 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568183 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 03 23:24:42.568372 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568189 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 03 23:24:42.568372 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568195 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 03 23:24:42.568372 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568206 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 03 23:24:42.568372 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568211 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 03 23:24:42.568921 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568909 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 03 23:24:42.568952 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.568922 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 03 23:24:42.569077 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.569049 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-117.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 03 23:24:42.569183 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.569100 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 03 23:24:42.569417 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.569398 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdcdk" Jun 03 23:24:42.572031 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.572016 2566 server.go:1268] "Started kubelet" Jun 03 23:24:42.572443 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.572411 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 03 23:24:42.572523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.572390 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 03 23:24:42.572523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.572489 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 03 23:24:42.572875 ip-10-0-131-117 systemd[1]: Started Kubernetes Kubelet. Jun 03 23:24:42.574069 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.574049 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 03 23:24:42.574449 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.574435 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 03 23:24:42.577768 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.577747 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdcdk" Jun 03 23:24:42.578700 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.578684 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 03 23:24:42.578793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.578700 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 03 23:24:42.578888 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.578865 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:42.579438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579366 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 03 23:24:42.579438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579388 2566 factory.go:55] Registering systemd factory Jun 03 23:24:42.579438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579398 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 03 23:24:42.579438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579413 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 03 23:24:42.579438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579403 2566 factory.go:223] Registration of the systemd container factory successfully Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579502 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579510 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579674 2566 factory.go:153] Registering CRI-O factory Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579687 2566 factory.go:223] Registration of the crio container factory successfully Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579733 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579755 2566 factory.go:103] Registering Raw factory Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.579755 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 03 23:24:42.579898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579769 2566 manager.go:1196] Started watching for new ooms in manager Jun 03 23:24:42.580256 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.579905 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-117.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 03 23:24:42.580256 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.580055 2566 manager.go:349] Starting recovery of all containers Jun 03 23:24:42.580792 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.579796 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-117.ec2.internal.18b5b5c456f497fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-117.ec2.internal,UID:ip-10-0-131-117.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-117.ec2.internal,},FirstTimestamp:2026-06-03 23:24:42.57198694 +0000 UTC m=+0.381494113,LastTimestamp:2026-06-03 23:24:42.57198694 +0000 UTC m=+0.381494113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-117.ec2.internal,}" Jun 03 23:24:42.591480 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.591295 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:42.592042 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.592027 2566 manager.go:354] Recovery completed Jun 03 23:24:42.593441 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.593405 2566 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 03 23:24:42.593955 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.593937 2566 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.596203 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.596191 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.597895 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.597879 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.597895 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.597907 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.597996 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.597917 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.598430 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.598414 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 03 23:24:42.598430 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.598429 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 03 23:24:42.598557 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.598448 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 03 23:24:42.598557 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.598463 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.599073 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.599057 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.599121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.599087 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.599121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.599104 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.599431 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.599419 2566 policy_none.go:49] "None policy: Start" Jun 03 23:24:42.599493 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.599439 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 03 23:24:42.599493 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.599452 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 03 23:24:42.600439 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.600427 2566 policy_none.go:47] "Start" Jun 03 23:24:42.634893 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.634878 2566 manager.go:337] "Starting Device Plugin manager" Jun 03 23:24:42.634969 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.634919 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 03 23:24:42.634969 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.634928 2566 server.go:87] "Starting device plugin registration server" Jun 03 23:24:42.635164 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.635152 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 03 23:24:42.635200 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.635167 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 03 23:24:42.635295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.635275 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 03 23:24:42.635391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.635375 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 03 23:24:42.635391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.635384 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 03 23:24:42.636049 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.636030 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 03 23:24:42.636116 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.636082 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:42.654062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.651919 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 03 23:24:42.654062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.653177 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 03 23:24:42.654062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.653219 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 03 23:24:42.654062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.653257 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 03 23:24:42.654062 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.653349 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 03 23:24:42.655274 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.655255 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:42.735462 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.735444 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.736386 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.736367 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.736468 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.736392 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.736468 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.736403 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.736468 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.736433 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.744413 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.744373 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.744413 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.744395 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-117.ec2.internal\": node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:42.753540 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.753517 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal"] Jun 03 23:24:42.753595 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.753575 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.754894 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.754878 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.754941 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.754909 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.754941 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.754929 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.756064 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.756052 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.756878 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.756852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.756918 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.756901 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.757391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.757371 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.757472 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.757376 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.757472 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.757441 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.757472 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.757455 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.757472 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.757404 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.757593 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.757489 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.757800 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.757783 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:42.758488 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.758473 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.758569 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.758504 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 03 23:24:42.759099 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.759085 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientMemory" Jun 03 23:24:42.759174 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.759129 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasNoDiskPressure" Jun 03 23:24:42.759174 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.759150 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeHasSufficientPID" Jun 03 23:24:42.777921 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.777899 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.780507 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.780474 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bc2a23ae5a13f0ffb05c3c31d28cbf8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"3bc2a23ae5a13f0ffb05c3c31d28cbf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.780594 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.780509 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bc2a23ae5a13f0ffb05c3c31d28cbf8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"3bc2a23ae5a13f0ffb05c3c31d28cbf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.780594 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.780554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a00b464b27ecad8ecd553fc28c1d8a0a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"a00b464b27ecad8ecd553fc28c1d8a0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.782080 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.782066 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-117.ec2.internal\" not found" node="ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.858560 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.858540 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:42.880784 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.880760 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bc2a23ae5a13f0ffb05c3c31d28cbf8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"3bc2a23ae5a13f0ffb05c3c31d28cbf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.880882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.880794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bc2a23ae5a13f0ffb05c3c31d28cbf8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"3bc2a23ae5a13f0ffb05c3c31d28cbf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.880882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.880816 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a00b464b27ecad8ecd553fc28c1d8a0a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"a00b464b27ecad8ecd553fc28c1d8a0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.880882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.880868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3bc2a23ae5a13f0ffb05c3c31d28cbf8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"3bc2a23ae5a13f0ffb05c3c31d28cbf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.880882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.880877 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bc2a23ae5a13f0ffb05c3c31d28cbf8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal\" (UID: \"3bc2a23ae5a13f0ffb05c3c31d28cbf8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.881030 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:42.880879 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a00b464b27ecad8ecd553fc28c1d8a0a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-117.ec2.internal\" (UID: \"a00b464b27ecad8ecd553fc28c1d8a0a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" Jun 03 23:24:42.959445 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:42.959414 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.060073 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.060000 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.080275 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.080255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:43.086089 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.086068 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" Jun 03 23:24:43.160878 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.160847 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.261334 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.261306 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.361812 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.361749 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.456796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.456775 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:43.461846 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.461809 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.514243 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.514218 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 03 23:24:43.514874 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.514398 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:43.514874 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.514401 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:43.514874 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.514428 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 03 23:24:43.562684 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.562657 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.568800 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:43.568757 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc2a23ae5a13f0ffb05c3c31d28cbf8.slice/crio-983a8e89f7daf60810bb8b870231a534b661dfc53dabe814ccb50fca05060bdf WatchSource:0}: Error finding container 983a8e89f7daf60810bb8b870231a534b661dfc53dabe814ccb50fca05060bdf: Status 404 returned error can't find the container with id 983a8e89f7daf60810bb8b870231a534b661dfc53dabe814ccb50fca05060bdf Jun 03 23:24:43.569094 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:43.569075 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00b464b27ecad8ecd553fc28c1d8a0a.slice/crio-5821df6e18b6cb5b3fb947824ac067ad92b64b5acdd2c4d4f1cdbbcd1a3593b4 WatchSource:0}: Error finding container 5821df6e18b6cb5b3fb947824ac067ad92b64b5acdd2c4d4f1cdbbcd1a3593b4: Status 404 returned error can't find the container with id 5821df6e18b6cb5b3fb947824ac067ad92b64b5acdd2c4d4f1cdbbcd1a3593b4 Jun 03 23:24:43.573803 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.573789 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:24:43.583370 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.583313 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 23:19:42 +0000 UTC" deadline="2027-12-08 17:30:38.085095702 +0000 UTC" Jun 03 23:24:43.583370 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.583369 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13266h5m54.501729228s" Jun 03 23:24:43.656207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.656133 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"3bc2a23ae5a13f0ffb05c3c31d28cbf8","Type":"ContainerStarted","Data":"983a8e89f7daf60810bb8b870231a534b661dfc53dabe814ccb50fca05060bdf"} Jun 03 23:24:43.657248 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:43.657229 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" event={"ID":"a00b464b27ecad8ecd553fc28c1d8a0a","Type":"ContainerStarted","Data":"5821df6e18b6cb5b3fb947824ac067ad92b64b5acdd2c4d4f1cdbbcd1a3593b4"} Jun 03 23:24:43.663372 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.663356 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.763821 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.763800 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.864293 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.864267 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:43.964759 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:43.964734 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-117.ec2.internal\" not found" Jun 03 23:24:44.045404 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.045371 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:44.079617 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.079590 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" Jun 03 23:24:44.092143 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.092113 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:24:44.093258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.093233 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" Jun 03 23:24:44.101720 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.101699 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 03 23:24:44.390973 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.390903 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:44.559936 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.559904 2566 apiserver.go:52] "Watching apiserver" Jun 03 23:24:44.572865 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.572839 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 03 23:24:44.573277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.573256 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal","openshift-multus/multus-7jlj9","openshift-network-diagnostics/network-check-target-f4n8s","openshift-network-operator/iptables-alerter-ftpmc","kube-system/konnectivity-agent-qq49n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp","openshift-cluster-node-tuning-operator/tuned-d595m","openshift-multus/multus-additional-cni-plugins-zpsb8","openshift-multus/network-metrics-daemon-hqhlq","openshift-ovn-kubernetes/ovnkube-node-c86qb","kube-system/global-pull-secret-syncer-2qcrt","kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal","openshift-dns/node-resolver-qrxwn","openshift-image-registry/node-ca-dm5ql"] Jun 03 23:24:44.574597 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.574570 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.575914 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.575891 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.576835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.576820 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:44.576929 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.576886 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:44.577818 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.577794 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.577921 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.577795 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.577921 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.577807 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qcz9h\"" Jun 03 23:24:44.577921 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.577912 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.579279 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.578827 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 03 23:24:44.579279 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.578936 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.579279 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.579150 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.579492 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.579353 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9x8hg\"" Jun 03 23:24:44.580021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.580002 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.580525 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.580507 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.580700 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.580688 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 03 23:24:44.580743 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.580694 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.580900 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.580882 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-w8259\"" Jun 03 23:24:44.581015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.580937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.582145 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.582123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:44.582236 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.582204 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:44.583803 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.583784 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rmxns\"" Jun 03 23:24:44.583895 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.583868 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.584043 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.584027 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 03 23:24:44.584043 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.584038 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 03 23:24:44.584149 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.583790 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 03 23:24:44.584271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.584256 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.585341 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.585305 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gf5bl\"" Jun 03 23:24:44.585545 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.585530 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.586955 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.586935 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.587537 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.587515 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 03 23:24:44.587868 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.587847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.587868 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.587862 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zhz7d\"" Jun 03 23:24:44.588067 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.588052 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.588272 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.588255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.589847 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.589828 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.590176 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590158 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 03 23:24:44.590342 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590161 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q2x7q\"" Jun 03 23:24:44.590484 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590167 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 03 23:24:44.590573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590180 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.590634 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.590609 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:44.590736 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590715 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f479cf-da5a-486c-8a55-e1c747cca628-tmp-dir\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.590819 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590752 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:44.590819 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6711394c-4a52-42fe-b54e-034cec0523f9-host-slash\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.590922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysctl-conf\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.590922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-systemd\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.590922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d7214c7-18c9-43c5-8a48-c9bd2149aa14-konnectivity-ca\") pod \"konnectivity-agent-qq49n\" (UID: \"2d7214c7-18c9-43c5-8a48-c9bd2149aa14\") " pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.590922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-modprobe-d\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590943 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysctl-d\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-lib-modules\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.590999 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-tuned\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591014 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdx7p\" (UniqueName: \"kubernetes.io/projected/9740d0e3-0568-41c8-bfba-8773bce4c709-kube-api-access-hdx7p\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09f479cf-da5a-486c-8a55-e1c747cca628-hosts-file\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-host\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591090 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9740d0e3-0568-41c8-bfba-8773bce4c709-tmp\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591124 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-999k9\" (UniqueName: \"kubernetes.io/projected/09f479cf-da5a-486c-8a55-e1c747cca628-kube-api-access-999k9\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591129 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6711394c-4a52-42fe-b54e-034cec0523f9-iptables-alerter-script\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxq29\" (UniqueName: \"kubernetes.io/projected/6711394c-4a52-42fe-b54e-034cec0523f9-kube-api-access-lxq29\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591222 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d7214c7-18c9-43c5-8a48-c9bd2149aa14-agent-certs\") pod \"konnectivity-agent-qq49n\" (UID: \"2d7214c7-18c9-43c5-8a48-c9bd2149aa14\") " pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysconfig\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-kubernetes\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-run\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-sys\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-var-lib-kubelet\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.591523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591503 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 03 23:24:44.591910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591552 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.591910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591574 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 03 23:24:44.591910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591706 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 03 23:24:44.591910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.591878 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 03 23:24:44.592911 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.592895 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8mp4b\"" Jun 03 23:24:44.593044 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.592957 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 03 23:24:44.593044 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.592969 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 03 23:24:44.593179 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.592976 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 03 23:24:44.594893 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.594759 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 03 23:24:44.594893 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.594791 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t6xsr\"" Jun 03 23:24:44.594893 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.594832 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 03 23:24:44.610061 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.610039 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-llp2j" Jun 03 23:24:44.618126 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.618108 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-llp2j" Jun 03 23:24:44.680447 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.680392 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 03 23:24:44.692076 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692052 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-kubernetes\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692076 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-kubernetes\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-run\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692127 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:44.692228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692148 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-run-netns\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.692228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692172 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovnkube-config\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.692228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692196 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-socket-dir-parent\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.692228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31e2628b-4f0f-48ae-84b4-ca683ad68476-kubelet-config\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692258 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysctl-conf\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692271 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-run\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d7214c7-18c9-43c5-8a48-c9bd2149aa14-konnectivity-ca\") pod \"konnectivity-agent-qq49n\" (UID: \"2d7214c7-18c9-43c5-8a48-c9bd2149aa14\") " pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692345 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-etc-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovnkube-script-lib\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692419 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-etc-kubernetes\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysctl-conf\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692513 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvp2g\" (UniqueName: \"kubernetes.io/projected/715889a5-a2b1-421e-85ae-a546afcbab11-kube-api-access-mvp2g\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdx7p\" (UniqueName: \"kubernetes.io/projected/9740d0e3-0568-41c8-bfba-8773bce4c709-kube-api-access-hdx7p\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692566 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6711394c-4a52-42fe-b54e-034cec0523f9-iptables-alerter-script\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-os-release\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692632 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-kubelet\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692654 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-node-log\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692685 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b75f0eec-6b19-4269-9880-55b6112fca1c-host\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692726 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-daemon-config\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692746 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysconfig\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f479cf-da5a-486c-8a55-e1c747cca628-tmp-dir\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692854 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysconfig\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692858 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-system-cni-dir\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692872 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d7214c7-18c9-43c5-8a48-c9bd2149aa14-konnectivity-ca\") pod \"konnectivity-agent-qq49n\" (UID: \"2d7214c7-18c9-43c5-8a48-c9bd2149aa14\") " pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-cni-multus\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.692925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692931 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-conf-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692969 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-systemd\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.692995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-cni-bin\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693030 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-socket-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-registration-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693100 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/09f479cf-da5a-486c-8a55-e1c747cca628-tmp-dir\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-sys-fs\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6711394c-4a52-42fe-b54e-034cec0523f9-iptables-alerter-script\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693151 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-systemd\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-system-cni-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693201 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-tuned\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09f479cf-da5a-486c-8a55-e1c747cca628-hosts-file\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d7214c7-18c9-43c5-8a48-c9bd2149aa14-agent-certs\") pod \"konnectivity-agent-qq49n\" (UID: \"2d7214c7-18c9-43c5-8a48-c9bd2149aa14\") " pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b75f0eec-6b19-4269-9880-55b6112fca1c-serviceca\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-os-release\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9740d0e3-0568-41c8-bfba-8773bce4c709-tmp\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.693573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-slash\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693358 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-run-ovn-kubernetes\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693304 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/09f479cf-da5a-486c-8a55-e1c747cca628-hosts-file\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693373 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-hostroot\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-sys\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-var-lib-kubelet\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693464 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693466 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693482 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-sys\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693492 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-cnibin\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693542 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693562 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-multus-certs\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-var-lib-kubelet\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.693580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7z7w\" (UniqueName: \"kubernetes.io/projected/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-kube-api-access-c7z7w\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694018 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.694259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-modprobe-d\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysctl-d\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-lib-modules\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxq29\" (UniqueName: \"kubernetes.io/projected/6711394c-4a52-42fe-b54e-034cec0523f9-kube-api-access-lxq29\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-modprobe-d\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694364 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-lib-modules\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-sysctl-d\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-device-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694509 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-host\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694534 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-999k9\" (UniqueName: \"kubernetes.io/projected/09f479cf-da5a-486c-8a55-e1c747cca628-kube-api-access-999k9\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694539 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9740d0e3-0568-41c8-bfba-8773bce4c709-host\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694559 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-ovn\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-env-overrides\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694604 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b9q7\" (UniqueName: \"kubernetes.io/projected/919ffab0-8434-4fc2-b203-5c02d26c9ef0-kube-api-access-5b9q7\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694640 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-cnibin\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfv4r\" (UniqueName: \"kubernetes.io/projected/b75f0eec-6b19-4269-9880-55b6112fca1c-kube-api-access-mfv4r\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-netns\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.694792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6711394c-4a52-42fe-b54e-034cec0523f9-host-slash\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694768 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-log-socket\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694778 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6711394c-4a52-42fe-b54e-034cec0523f9-host-slash\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694813 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-cni-netd\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694837 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694875 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-etc-selinux\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694907 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-cni-binary-copy\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694926 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-systemd\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfxf\" (UniqueName: \"kubernetes.io/projected/a5913026-afd2-4ad8-8a33-67f406110ecd-kube-api-access-wmfxf\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.694985 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-cni-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695005 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-kubelet\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31e2628b-4f0f-48ae-84b4-ca683ad68476-dbus\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695045 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-systemd-units\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695069 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpjjq\" (UniqueName: \"kubernetes.io/projected/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-kube-api-access-lpjjq\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-cni-bin\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695115 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-var-lib-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.695258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovn-node-metrics-cert\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.695744 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-k8s-cni-cncf-io\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.695744 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.695181 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.696497 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.696472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9740d0e3-0568-41c8-bfba-8773bce4c709-etc-tuned\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.696604 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.696591 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9740d0e3-0568-41c8-bfba-8773bce4c709-tmp\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.697564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.697540 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d7214c7-18c9-43c5-8a48-c9bd2149aa14-agent-certs\") pod \"konnectivity-agent-qq49n\" (UID: \"2d7214c7-18c9-43c5-8a48-c9bd2149aa14\") " pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.704070 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.704047 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:44.704177 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.704082 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:44.704177 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.704092 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:44.704177 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.704174 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:45.204134099 +0000 UTC m=+3.013641278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:44.707026 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.707006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-999k9\" (UniqueName: \"kubernetes.io/projected/09f479cf-da5a-486c-8a55-e1c747cca628-kube-api-access-999k9\") pod \"node-resolver-qrxwn\" (UID: \"09f479cf-da5a-486c-8a55-e1c747cca628\") " pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.708380 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.708357 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdx7p\" (UniqueName: \"kubernetes.io/projected/9740d0e3-0568-41c8-bfba-8773bce4c709-kube-api-access-hdx7p\") pod \"tuned-d595m\" (UID: \"9740d0e3-0568-41c8-bfba-8773bce4c709\") " pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.710306 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.710285 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxq29\" (UniqueName: \"kubernetes.io/projected/6711394c-4a52-42fe-b54e-034cec0523f9-kube-api-access-lxq29\") pod \"iptables-alerter-ftpmc\" (UID: \"6711394c-4a52-42fe-b54e-034cec0523f9\") " pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.712699 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.712679 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:44.796074 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-run-netns\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovnkube-config\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796110 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-socket-dir-parent\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31e2628b-4f0f-48ae-84b4-ca683ad68476-kubelet-config\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-etc-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796176 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-run-netns\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovnkube-script-lib\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-etc-kubernetes\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796257 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-socket-dir-parent\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796268 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796299 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvp2g\" (UniqueName: \"kubernetes.io/projected/715889a5-a2b1-421e-85ae-a546afcbab11-kube-api-access-mvp2g\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796345 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-os-release\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-kubelet\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-node-log\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b75f0eec-6b19-4269-9880-55b6112fca1c-host\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-daemon-config\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796458 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-system-cni-dir\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796480 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-cni-multus\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-conf-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-cni-bin\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-socket-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.796601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-registration-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796623 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-sys-fs\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796648 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-system-cni-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b75f0eec-6b19-4269-9880-55b6112fca1c-serviceca\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-os-release\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-slash\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796745 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-run-ovn-kubernetes\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-hostroot\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796777 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovnkube-script-lib\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796777 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovnkube-config\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/31e2628b-4f0f-48ae-84b4-ca683ad68476-kubelet-config\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-cnibin\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796871 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-multus-certs\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796931 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-os-release\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.797257 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7z7w\" (UniqueName: \"kubernetes.io/projected/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-kube-api-access-c7z7w\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-kubelet\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.796994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797004 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-node-log\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797041 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b75f0eec-6b19-4269-9880-55b6112fca1c-host\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-device-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797077 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-ovn\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797079 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-os-release\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-env-overrides\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797125 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b9q7\" (UniqueName: \"kubernetes.io/projected/919ffab0-8434-4fc2-b203-5c02d26c9ef0-kube-api-access-5b9q7\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797133 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-slash\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797148 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-cnibin\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfv4r\" (UniqueName: \"kubernetes.io/projected/b75f0eec-6b19-4269-9880-55b6112fca1c-kube-api-access-mfv4r\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-run-ovn-kubernetes\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-netns\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797236 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-netns\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-log-socket\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.797890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797280 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-log-socket\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797342 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-etc-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797349 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-hostroot\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797350 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b75f0eec-6b19-4269-9880-55b6112fca1c-serviceca\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-cni-netd\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-sys-fs\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797410 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-system-cni-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797440 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-etc-kubernetes\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797502 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-socket-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-daemon-config\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797547 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-cni-multus\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797581 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-system-cni-dir\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797604 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-conf-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797643 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-cni-bin\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797684 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797721 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-etc-selinux\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.798800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797762 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-cni-binary-copy\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797763 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-etc-selinux\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797805 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-device-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-systemd\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfxf\" (UniqueName: \"kubernetes.io/projected/a5913026-afd2-4ad8-8a33-67f406110ecd-kube-api-access-wmfxf\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-cni-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797914 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-kubelet\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31e2628b-4f0f-48ae-84b4-ca683ad68476-dbus\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797998 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-systemd-units\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797963 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-systemd-units\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798032 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpjjq\" (UniqueName: \"kubernetes.io/projected/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-kube-api-access-lpjjq\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798017 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-ovn\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798060 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-cni-bin\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-var-lib-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798109 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovn-node-metrics-cert\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-k8s-cni-cncf-io\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.799502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798213 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/715889a5-a2b1-421e-85ae-a546afcbab11-cnibin\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798223 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-cni-binary-copy\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798263 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-cnibin\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.798282 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-host-cni-netd\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.798367 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:45.298348673 +0000 UTC m=+3.107855851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.797967 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.798382 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798417 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-multus-cni-dir\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:44.798433 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:45.298415793 +0000 UTC m=+3.107922955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798428 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-registration-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798464 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-multus-certs\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798464 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-cni-bin\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798520 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5913026-afd2-4ad8-8a33-67f406110ecd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-var-lib-openvswitch\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798576 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/31e2628b-4f0f-48ae-84b4-ca683ad68476-dbus\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:44.800015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-var-lib-kubelet\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800501 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798622 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/919ffab0-8434-4fc2-b203-5c02d26c9ef0-run-systemd\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.800501 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798632 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-host-run-k8s-cni-cncf-io\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.800501 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.798840 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/919ffab0-8434-4fc2-b203-5c02d26c9ef0-env-overrides\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.800501 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.799293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/715889a5-a2b1-421e-85ae-a546afcbab11-cni-binary-copy\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.800714 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.800697 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/919ffab0-8434-4fc2-b203-5c02d26c9ef0-ovn-node-metrics-cert\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.806104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.806044 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvp2g\" (UniqueName: \"kubernetes.io/projected/715889a5-a2b1-421e-85ae-a546afcbab11-kube-api-access-mvp2g\") pod \"multus-additional-cni-plugins-zpsb8\" (UID: \"715889a5-a2b1-421e-85ae-a546afcbab11\") " pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:44.807191 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.807168 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfxf\" (UniqueName: \"kubernetes.io/projected/a5913026-afd2-4ad8-8a33-67f406110ecd-kube-api-access-wmfxf\") pod \"aws-ebs-csi-driver-node-f42sp\" (UID: \"a5913026-afd2-4ad8-8a33-67f406110ecd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.807337 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.807246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b9q7\" (UniqueName: \"kubernetes.io/projected/919ffab0-8434-4fc2-b203-5c02d26c9ef0-kube-api-access-5b9q7\") pod \"ovnkube-node-c86qb\" (UID: \"919ffab0-8434-4fc2-b203-5c02d26c9ef0\") " pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.807788 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.807753 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7z7w\" (UniqueName: \"kubernetes.io/projected/6829bb8e-8bac-4a2f-a16c-db631bfc1dea-kube-api-access-c7z7w\") pod \"multus-7jlj9\" (UID: \"6829bb8e-8bac-4a2f-a16c-db631bfc1dea\") " pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.807869 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.807753 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfv4r\" (UniqueName: \"kubernetes.io/projected/b75f0eec-6b19-4269-9880-55b6112fca1c-kube-api-access-mfv4r\") pod \"node-ca-dm5ql\" (UID: \"b75f0eec-6b19-4269-9880-55b6112fca1c\") " pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.808755 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.808738 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpjjq\" (UniqueName: \"kubernetes.io/projected/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-kube-api-access-lpjjq\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:44.887489 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.887447 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d595m" Jun 03 23:24:44.895533 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.895513 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qrxwn" Jun 03 23:24:44.905306 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.905284 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ftpmc" Jun 03 23:24:44.909951 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.909930 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:24:44.916572 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.916554 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" Jun 03 23:24:44.923184 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.923165 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dm5ql" Jun 03 23:24:44.929922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.929904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jlj9" Jun 03 23:24:44.936924 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.936902 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:24:44.941577 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:44.941553 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" Jun 03 23:24:45.302308 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.302272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:45.302486 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.302334 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:45.302486 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.302390 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:45.302486 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302457 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:45.302486 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302471 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:45.302711 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302515 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:46.302496711 +0000 UTC m=+4.112003883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:45.302711 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302530 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:46.302521737 +0000 UTC m=+4.112028896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:45.302711 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302540 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:45.302711 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302563 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:45.302711 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302576 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:45.302711 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:45.302635 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:46.302615478 +0000 UTC m=+4.112122652 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:45.404546 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.404519 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod715889a5_a2b1_421e_85ae_a546afcbab11.slice/crio-8c634ca93851f573e77c62616864f9ce7c316ac2c19686ce0db494e6b528f938 WatchSource:0}: Error finding container 8c634ca93851f573e77c62616864f9ce7c316ac2c19686ce0db494e6b528f938: Status 404 returned error can't find the container with id 8c634ca93851f573e77c62616864f9ce7c316ac2c19686ce0db494e6b528f938 Jun 03 23:24:45.405615 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.405580 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75f0eec_6b19_4269_9880_55b6112fca1c.slice/crio-cbd23a6c66eb5bc8ec1cb375d97659d17a2872a6d14850ab6b8c85f9c6b1c141 WatchSource:0}: Error finding container cbd23a6c66eb5bc8ec1cb375d97659d17a2872a6d14850ab6b8c85f9c6b1c141: Status 404 returned error can't find the container with id cbd23a6c66eb5bc8ec1cb375d97659d17a2872a6d14850ab6b8c85f9c6b1c141 Jun 03 23:24:45.406505 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.406394 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09f479cf_da5a_486c_8a55_e1c747cca628.slice/crio-7081e5ae97511a753c0074bcf9d1064f459ab072e13d8111d48b5aca4c80c4bc WatchSource:0}: Error finding container 7081e5ae97511a753c0074bcf9d1064f459ab072e13d8111d48b5aca4c80c4bc: Status 404 returned error can't find the container with id 7081e5ae97511a753c0074bcf9d1064f459ab072e13d8111d48b5aca4c80c4bc Jun 03 23:24:45.410510 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.410491 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919ffab0_8434_4fc2_b203_5c02d26c9ef0.slice/crio-7937b14b0a1e6ec06729a5645a0535d9ee5f7a589e7333791639e94cbf35a91d WatchSource:0}: Error finding container 7937b14b0a1e6ec06729a5645a0535d9ee5f7a589e7333791639e94cbf35a91d: Status 404 returned error can't find the container with id 7937b14b0a1e6ec06729a5645a0535d9ee5f7a589e7333791639e94cbf35a91d Jun 03 23:24:45.412066 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.412042 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7214c7_18c9_43c5_8a48_c9bd2149aa14.slice/crio-0ad3f47713bf56f004ebe0fa4a77bc93971968a0d1aeac7c55b495649a2a1419 WatchSource:0}: Error finding container 0ad3f47713bf56f004ebe0fa4a77bc93971968a0d1aeac7c55b495649a2a1419: Status 404 returned error can't find the container with id 0ad3f47713bf56f004ebe0fa4a77bc93971968a0d1aeac7c55b495649a2a1419 Jun 03 23:24:45.413822 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.413801 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6711394c_4a52_42fe_b54e_034cec0523f9.slice/crio-50fcefa615e976c8cfc5a80cb80be0d7ac795dc4534071913d39561bdc807f22 WatchSource:0}: Error finding container 50fcefa615e976c8cfc5a80cb80be0d7ac795dc4534071913d39561bdc807f22: Status 404 returned error can't find the container with id 50fcefa615e976c8cfc5a80cb80be0d7ac795dc4534071913d39561bdc807f22 Jun 03 23:24:45.414675 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.414654 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9740d0e3_0568_41c8_bfba_8773bce4c709.slice/crio-595523166f83e60dfd92d0153350e3dd9c95d58ac10abf256c94865fc8d41932 WatchSource:0}: Error finding container 595523166f83e60dfd92d0153350e3dd9c95d58ac10abf256c94865fc8d41932: Status 404 returned error can't find the container with id 595523166f83e60dfd92d0153350e3dd9c95d58ac10abf256c94865fc8d41932 Jun 03 23:24:45.415417 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.415395 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6829bb8e_8bac_4a2f_a16c_db631bfc1dea.slice/crio-957db79d61c5fe35b82218be365507973cc6257c44e702a1588bf461e7e5a2b0 WatchSource:0}: Error finding container 957db79d61c5fe35b82218be365507973cc6257c44e702a1588bf461e7e5a2b0: Status 404 returned error can't find the container with id 957db79d61c5fe35b82218be365507973cc6257c44e702a1588bf461e7e5a2b0 Jun 03 23:24:45.417041 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:24:45.417017 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5913026_afd2_4ad8_8a33_67f406110ecd.slice/crio-396dc48042e9dcd08869848f78015af9d99f19ae0e3ee76c7c8e1f89798b8760 WatchSource:0}: Error finding container 396dc48042e9dcd08869848f78015af9d99f19ae0e3ee76c7c8e1f89798b8760: Status 404 returned error can't find the container with id 396dc48042e9dcd08869848f78015af9d99f19ae0e3ee76c7c8e1f89798b8760 Jun 03 23:24:45.620877 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.620770 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:44 +0000 UTC" deadline="2027-12-30 16:34:35.981486912 +0000 UTC" Jun 03 23:24:45.620877 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.620831 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13793h9m50.360658264s" Jun 03 23:24:45.661496 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.661462 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ftpmc" event={"ID":"6711394c-4a52-42fe-b54e-034cec0523f9","Type":"ContainerStarted","Data":"50fcefa615e976c8cfc5a80cb80be0d7ac795dc4534071913d39561bdc807f22"} Jun 03 23:24:45.662808 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.662785 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 03 23:24:45.663414 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.663372 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qq49n" event={"ID":"2d7214c7-18c9-43c5-8a48-c9bd2149aa14","Type":"ContainerStarted","Data":"0ad3f47713bf56f004ebe0fa4a77bc93971968a0d1aeac7c55b495649a2a1419"} Jun 03 23:24:45.664665 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.664643 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"7937b14b0a1e6ec06729a5645a0535d9ee5f7a589e7333791639e94cbf35a91d"} Jun 03 23:24:45.665639 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.665618 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrxwn" event={"ID":"09f479cf-da5a-486c-8a55-e1c747cca628","Type":"ContainerStarted","Data":"7081e5ae97511a753c0074bcf9d1064f459ab072e13d8111d48b5aca4c80c4bc"} Jun 03 23:24:45.666710 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.666687 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerStarted","Data":"8c634ca93851f573e77c62616864f9ce7c316ac2c19686ce0db494e6b528f938"} Jun 03 23:24:45.668709 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.668687 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" event={"ID":"a00b464b27ecad8ecd553fc28c1d8a0a","Type":"ContainerStarted","Data":"bda71a71027913b32fbd72906fe504bdc6546f6e7706e480418bc094f4ba39b2"} Jun 03 23:24:45.669842 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.669823 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d595m" event={"ID":"9740d0e3-0568-41c8-bfba-8773bce4c709","Type":"ContainerStarted","Data":"595523166f83e60dfd92d0153350e3dd9c95d58ac10abf256c94865fc8d41932"} Jun 03 23:24:45.670920 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.670896 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dm5ql" event={"ID":"b75f0eec-6b19-4269-9880-55b6112fca1c","Type":"ContainerStarted","Data":"cbd23a6c66eb5bc8ec1cb375d97659d17a2872a6d14850ab6b8c85f9c6b1c141"} Jun 03 23:24:45.673409 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.673349 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" event={"ID":"a5913026-afd2-4ad8-8a33-67f406110ecd","Type":"ContainerStarted","Data":"396dc48042e9dcd08869848f78015af9d99f19ae0e3ee76c7c8e1f89798b8760"} Jun 03 23:24:45.675695 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.675670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jlj9" event={"ID":"6829bb8e-8bac-4a2f-a16c-db631bfc1dea","Type":"ContainerStarted","Data":"957db79d61c5fe35b82218be365507973cc6257c44e702a1588bf461e7e5a2b0"} Jun 03 23:24:45.684514 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:45.684475 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-117.ec2.internal" podStartSLOduration=1.684464577 podStartE2EDuration="1.684464577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:45.684217693 +0000 UTC m=+3.493724876" watchObservedRunningTime="2026-06-03 23:24:45.684464577 +0000 UTC m=+3.493971790" Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.310152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.310207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.310263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310407 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310473 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:48.310453008 +0000 UTC m=+6.119960170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310739 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310773 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310787 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310845 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:48.310820172 +0000 UTC m=+6.120327344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310859 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:46.310949 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.310925 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:48.310908089 +0000 UTC m=+6.120415271 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:46.621219 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.621126 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 23:19:44 +0000 UTC" deadline="2027-11-11 19:03:00.894286494 +0000 UTC" Jun 03 23:24:46.621219 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.621170 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12619h38m14.27312253s" Jun 03 23:24:46.655802 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.655772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:46.655963 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.655911 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:46.656378 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.656358 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:46.656480 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.656460 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:46.656536 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.656525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:46.656621 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:46.656591 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:46.685761 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.684708 2566 generic.go:356] "Generic (PLEG): container finished" podID="3bc2a23ae5a13f0ffb05c3c31d28cbf8" containerID="7c4dd17af9f3ad63d4eef6f77702df7d972147ae1fdb73a1389f23d2197ab075" exitCode=0 Jun 03 23:24:46.685761 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:46.685581 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"3bc2a23ae5a13f0ffb05c3c31d28cbf8","Type":"ContainerDied","Data":"7c4dd17af9f3ad63d4eef6f77702df7d972147ae1fdb73a1389f23d2197ab075"} Jun 03 23:24:47.704788 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:47.704749 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" event={"ID":"3bc2a23ae5a13f0ffb05c3c31d28cbf8","Type":"ContainerStarted","Data":"6aedb7ea492dd8d4fb7a4d8cf74d09cf0f96d96f57cabbb92eb4811d1a30337b"} Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:48.327153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:48.327208 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:48.327261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327410 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327480 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:24:52.32745812 +0000 UTC m=+10.136965282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327548 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327591 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:52.327579447 +0000 UTC m=+10.137086633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327667 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327680 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327691 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:48.327842 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.327722 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:24:52.327712406 +0000 UTC m=+10.137219579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:48.654511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:48.654439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:48.654662 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:48.654439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:48.654662 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.654543 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:48.654662 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.654641 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:48.654873 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:48.654693 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:48.654873 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:48.654765 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:50.657443 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:50.656556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:50.657443 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:50.656749 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:50.657443 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:50.657119 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:50.657443 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:50.657258 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:50.657443 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:50.657313 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:50.657443 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:50.657398 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:52.363341 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:52.363282 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:52.363341 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:52.363370 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:52.364024 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:52.363402 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:52.364024 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.363540 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:24:52.364024 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.363561 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:24:52.364024 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.363575 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:52.364024 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.363630 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:00.363611992 +0000 UTC m=+18.173119154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:24:52.364024 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.364002 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:52.364284 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.364049 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:25:00.364037281 +0000 UTC m=+18.173544440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:24:52.364284 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.364102 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:52.364284 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.364135 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:00.364122079 +0000 UTC m=+18.173629252 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:24:52.655064 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:52.654996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:52.655200 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.655083 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:52.655425 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:52.655404 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:52.655503 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:52.655434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:52.655503 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.655489 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:52.655610 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:52.655539 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:54.656419 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:54.656381 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:54.656883 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:54.656522 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:54.656883 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:54.656820 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:54.656989 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:54.656887 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:54.656989 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:54.656917 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:54.656989 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:54.656969 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:56.653942 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:56.653910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:56.653942 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:56.653927 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:56.654425 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:56.653911 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:56.654425 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:56.654028 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:24:56.654425 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:56.654122 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:56.654425 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:56.654216 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:58.653798 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:58.653615 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:24:58.653798 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:58.653658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:24:58.653798 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:24:58.653617 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:24:58.653798 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:58.653755 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:24:58.654429 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:58.653816 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:24:58.654429 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:24:58.653882 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:00.422786 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:00.422757 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:00.422829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:00.422870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.422948 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.422956 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.422964 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.422974 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.422990 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.423025 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:16.423005677 +0000 UTC m=+34.232512837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.423046 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:25:16.423035996 +0000 UTC m=+34.232543156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:00.423285 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.423061 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:16.423052732 +0000 UTC m=+34.232559898 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:00.654478 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:00.654442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:00.654640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:00.654442 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:00.654640 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.654579 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:00.654743 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:00.654443 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:00.654743 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.654664 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:00.654838 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:00.654770 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:02.654707 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:02.654665 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:02.655165 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:02.654796 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:02.655165 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:02.655142 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:02.655302 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:02.655205 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:02.655302 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:02.655245 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:02.655302 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:02.655282 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:04.656315 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.654490 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:04.656315 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.654617 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:04.656315 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:04.654762 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:04.656315 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:04.654870 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:04.656315 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.654902 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:04.656315 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:04.654982 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:04.739020 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.738987 2566 generic.go:356] "Generic (PLEG): container finished" podID="715889a5-a2b1-421e-85ae-a546afcbab11" containerID="efd295ddd30a1314d373fd27f57d91ddd0aad460f5f7065715df0783d9a5993b" exitCode=0 Jun 03 23:25:04.739148 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.739081 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerDied","Data":"efd295ddd30a1314d373fd27f57d91ddd0aad460f5f7065715df0783d9a5993b"} Jun 03 23:25:04.741070 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.741042 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d595m" event={"ID":"9740d0e3-0568-41c8-bfba-8773bce4c709","Type":"ContainerStarted","Data":"3d5c30418ff19b81554a42a9018d71b1c168e8a7a8185e9fed8b5b44684f0506"} Jun 03 23:25:04.742753 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.742731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dm5ql" event={"ID":"b75f0eec-6b19-4269-9880-55b6112fca1c","Type":"ContainerStarted","Data":"7e07f031f4e3df6bc47ec73d93101dad237426597bf3231dba9699fe7fdf1d4d"} Jun 03 23:25:04.744306 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.744285 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" event={"ID":"a5913026-afd2-4ad8-8a33-67f406110ecd","Type":"ContainerStarted","Data":"cbb10cd33498aa3cc4588204a77d4e36122452a67f6a03de68178262f57064db"} Jun 03 23:25:04.745890 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.745858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jlj9" event={"ID":"6829bb8e-8bac-4a2f-a16c-db631bfc1dea","Type":"ContainerStarted","Data":"722af2e73c2e25cce60764e70be54ffb0d7517155ef908895570640e7a2beba2"} Jun 03 23:25:04.747527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.747507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qq49n" event={"ID":"2d7214c7-18c9-43c5-8a48-c9bd2149aa14","Type":"ContainerStarted","Data":"d6f6b6926de6f9cbeb531fc8fc7a75183b4f8411c99dceea9c7d8d0b6d29f316"} Jun 03 23:25:04.750385 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750351 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:25:04.750782 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750756 2566 generic.go:356] "Generic (PLEG): container finished" podID="919ffab0-8434-4fc2-b203-5c02d26c9ef0" containerID="f0fdfd50ec68eea0f55813fd9b5c7a6c2cf0a356d40f3139650c96c51e00af95" exitCode=1 Jun 03 23:25:04.750866 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750784 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"a34d464e3962eb5556fc9707e56954504b2c0c0f62517b447fcc42c630a96124"} Jun 03 23:25:04.750866 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"08af1473ff7b5f9304337cbb6ed25c99c9308e647ce7ba59efc01310a0cbbb26"} Jun 03 23:25:04.750966 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750879 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"b370c51ae920c4bab50700bb96497593d0c342b6994a5e78c74943c48bb3df45"} Jun 03 23:25:04.750966 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750911 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerDied","Data":"f0fdfd50ec68eea0f55813fd9b5c7a6c2cf0a356d40f3139650c96c51e00af95"} Jun 03 23:25:04.750966 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.750953 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"8b127dbe6c2f24662784ea1ac006196f4d374b4f817b071e87d6787db8a6ec94"} Jun 03 23:25:04.752540 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.752422 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qrxwn" event={"ID":"09f479cf-da5a-486c-8a55-e1c747cca628","Type":"ContainerStarted","Data":"28dc7b81572e92b5a9003338105228aef0f7e6943db9414b8a2ef28caea7a42e"} Jun 03 23:25:04.765074 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.765023 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-117.ec2.internal" podStartSLOduration=20.765005935 podStartE2EDuration="20.765005935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:24:47.721726512 +0000 UTC m=+5.531233705" watchObservedRunningTime="2026-06-03 23:25:04.765005935 +0000 UTC m=+22.574513117" Jun 03 23:25:04.782113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.782067 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qrxwn" podStartSLOduration=4.160739452 podStartE2EDuration="22.782051431s" totalImagesPullingTime="18.621311979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:04.781415945 +0000 UTC m=+22.590923126" watchObservedRunningTime="2026-06-03 23:25:04.782051431 +0000 UTC m=+22.591558613" Jun 03 23:25:04.801515 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.801481 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qq49n" podStartSLOduration=4.214018517 podStartE2EDuration="22.801467768s" totalImagesPullingTime="18.587449251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:04.801296106 +0000 UTC m=+22.610803287" watchObservedRunningTime="2026-06-03 23:25:04.801467768 +0000 UTC m=+22.610974949" Jun 03 23:25:04.840750 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.840705 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dm5ql" podStartSLOduration=4.247542736 podStartE2EDuration="22.840693248s" totalImagesPullingTime="18.593150512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:04.818685595 +0000 UTC m=+22.628192754" watchObservedRunningTime="2026-06-03 23:25:04.840693248 +0000 UTC m=+22.650200429" Jun 03 23:25:04.840898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.840806 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7jlj9" podStartSLOduration=4.182130446 podStartE2EDuration="22.840799452s" totalImagesPullingTime="18.658669006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:04.840359871 +0000 UTC m=+22.649867054" watchObservedRunningTime="2026-06-03 23:25:04.840799452 +0000 UTC m=+22.650306633" Jun 03 23:25:04.863553 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:04.863474 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d595m" podStartSLOduration=4.249191714 podStartE2EDuration="22.863457062s" totalImagesPullingTime="18.614265348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:04.863074714 +0000 UTC m=+22.672581926" watchObservedRunningTime="2026-06-03 23:25:04.863457062 +0000 UTC m=+22.672964245" Jun 03 23:25:05.486206 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.486167 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 03 23:25:05.649100 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.648928 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T23:25:05.48618882Z","UUID":"1a959a5c-4f1a-498f-be1a-dde06327c9ba","Handler":null,"Name":"","Endpoint":""} Jun 03 23:25:05.650629 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.650606 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 03 23:25:05.650745 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.650647 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 03 23:25:05.757248 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.757209 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" event={"ID":"a5913026-afd2-4ad8-8a33-67f406110ecd","Type":"ContainerStarted","Data":"ccf478f2e63411de4a16e0e2c1b8b838e1b01c43d49a8998bfb9a726ca2b4b24"} Jun 03 23:25:05.758827 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.758776 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ftpmc" event={"ID":"6711394c-4a52-42fe-b54e-034cec0523f9","Type":"ContainerStarted","Data":"4f98ffeb9b27f6cc68cb4b6890f070f351ecc9fc92df885ab6ed15a932e2eb60"} Jun 03 23:25:05.761986 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.761965 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:25:05.762834 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.762436 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"7d1e9dfc390a941aeb78323ff010e414d824539d3b0f63965cd48586908f717e"} Jun 03 23:25:05.775526 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:05.775488 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ftpmc" podStartSLOduration=5.189207615 podStartE2EDuration="23.775471773s" totalImagesPullingTime="18.586264158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:05.774846225 +0000 UTC m=+23.584353407" watchObservedRunningTime="2026-06-03 23:25:05.775471773 +0000 UTC m=+23.584978955" Jun 03 23:25:06.654107 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:06.653809 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:06.654249 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:06.653808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:06.654249 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:06.654165 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:06.654249 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:06.654227 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:06.654249 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:06.653808 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:06.654436 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:06.654311 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:06.767174 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:06.767131 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" event={"ID":"a5913026-afd2-4ad8-8a33-67f406110ecd","Type":"ContainerStarted","Data":"d965c76169846570119ce959bbe0e5491b18d2036ee7a49ee0345ccf43f9b0a7"} Jun 03 23:25:06.787675 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:06.787605 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f42sp" podStartSLOduration=4.241627697 podStartE2EDuration="24.787591687s" totalImagesPullingTime="20.54596399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:06.787286417 +0000 UTC m=+24.596793600" watchObservedRunningTime="2026-06-03 23:25:06.787591687 +0000 UTC m=+24.597098867" Jun 03 23:25:07.675483 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:07.675450 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:25:07.676022 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:07.676001 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:25:07.773476 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:07.773451 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:25:07.774006 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:07.773918 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"eacb889513f8d8d0cd0ce73305d506939f7e1cb0df52c14a50b0bfc0ee983b62"} Jun 03 23:25:08.653741 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:08.653703 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:08.653925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:08.653703 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:08.653925 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:08.653836 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:08.653925 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:08.653828 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:08.654076 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:08.653956 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:08.654076 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:08.654057 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:09.781253 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.781064 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:25:09.782039 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.781690 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"3d27fbaf30a2335498d32f6085c47eb693a4a4a85f054aa72b1887a3c5035be8"} Jun 03 23:25:09.782039 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.781981 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:25:09.782217 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.782197 2566 scope.go:117] "RemoveContainer" containerID="f0fdfd50ec68eea0f55813fd9b5c7a6c2cf0a356d40f3139650c96c51e00af95" Jun 03 23:25:09.783716 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.783687 2566 generic.go:356] "Generic (PLEG): container finished" podID="715889a5-a2b1-421e-85ae-a546afcbab11" containerID="56020256fb2017f45bb4a4855517a20ddfb8eeb7081d303035607a770008f241" exitCode=0 Jun 03 23:25:09.783827 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.783719 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerDied","Data":"56020256fb2017f45bb4a4855517a20ddfb8eeb7081d303035607a770008f241"} Jun 03 23:25:09.800280 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:09.800255 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:25:10.654414 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.654370 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:10.654414 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.654415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:10.654614 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.654370 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:10.654614 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:10.654499 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:10.654614 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:10.654557 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:10.654781 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:10.654625 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:10.789687 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.789491 2566 generic.go:356] "Generic (PLEG): container finished" podID="715889a5-a2b1-421e-85ae-a546afcbab11" containerID="5e898a07144563de81b265129dee8f2d7b8adace4b020cd0b34be2e3a6d82df4" exitCode=0 Jun 03 23:25:10.790060 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.789650 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerDied","Data":"5e898a07144563de81b265129dee8f2d7b8adace4b020cd0b34be2e3a6d82df4"} Jun 03 23:25:10.794647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.794629 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:25:10.795075 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.795050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" event={"ID":"919ffab0-8434-4fc2-b203-5c02d26c9ef0","Type":"ContainerStarted","Data":"c3990aafe089ec6b8f4832abacf9825a5560a3124e5f9ded745fa8b36b8fc8c0"} Jun 03 23:25:10.795456 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.795432 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:25:10.795543 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.795515 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:25:10.810761 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.810742 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:25:10.840517 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.840467 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" podStartSLOduration=10.201664896 podStartE2EDuration="28.840454773s" totalImagesPullingTime="18.638789877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:10.83990357 +0000 UTC m=+28.649410751" watchObservedRunningTime="2026-06-03 23:25:10.840454773 +0000 UTC m=+28.649961954" Jun 03 23:25:10.976456 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.976432 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4n8s"] Jun 03 23:25:10.976546 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.976513 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:10.976605 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:10.976589 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:10.979232 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.979211 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hqhlq"] Jun 03 23:25:10.979366 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.979310 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:10.979446 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:10.979424 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:10.979815 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.979794 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2qcrt"] Jun 03 23:25:10.979914 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:10.979869 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:10.979964 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:10.979947 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:11.799551 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:11.799519 2566 generic.go:356] "Generic (PLEG): container finished" podID="715889a5-a2b1-421e-85ae-a546afcbab11" containerID="3bfff1fad936b00ea96612e3981664c08ce227c8ff15cc717011214a28047a8f" exitCode=0 Jun 03 23:25:11.800055 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:11.799567 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerDied","Data":"3bfff1fad936b00ea96612e3981664c08ce227c8ff15cc717011214a28047a8f"} Jun 03 23:25:12.655334 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:12.655287 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:12.655490 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:12.655407 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:12.655784 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:12.655766 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:12.655901 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:12.655885 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:12.655970 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:12.655907 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:12.656007 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:12.655965 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:14.539298 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:14.539262 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:25:14.540069 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:14.539463 2566 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 03 23:25:14.540799 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:14.540776 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qq49n" Jun 03 23:25:14.653968 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:14.653941 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:14.654131 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:14.653941 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:14.654131 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:14.654061 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:14.654253 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:14.654131 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:14.654253 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:14.653942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:14.654253 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:14.654207 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:16.449420 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.449394 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.449431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.449465 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449531 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449549 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449596 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:25:48.449581889 +0000 UTC m=+66.259089048 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449595 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449609 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret podName:31e2628b-4f0f-48ae-84b4-ca683ad68476 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:48.449602047 +0000 UTC m=+66.259109206 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret") pod "global-pull-secret-syncer-2qcrt" (UID: "31e2628b-4f0f-48ae-84b4-ca683ad68476") : object "kube-system"/"original-pull-secret" not registered Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449615 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449625 2566 projected.go:196] Error preparing data for projected volume kube-api-access-7sv2k for pod openshift-network-diagnostics/network-check-target-f4n8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:16.449753 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.449660 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k podName:1f28d85f-494f-495d-a12c-492e2c2145d9 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:48.449648392 +0000 UTC m=+66.259155554 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7sv2k" (UniqueName: "kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k") pod "network-check-target-f4n8s" (UID: "1f28d85f-494f-495d-a12c-492e2c2145d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 03 23:25:16.653945 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.653913 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:16.654126 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.653915 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:16.654126 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.654048 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:25:16.654126 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.653921 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:16.654287 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.654082 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2qcrt" podUID="31e2628b-4f0f-48ae-84b4-ca683ad68476" Jun 03 23:25:16.654287 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:16.654185 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f4n8s" podUID="1f28d85f-494f-495d-a12c-492e2c2145d9" Jun 03 23:25:16.813845 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.813774 2566 generic.go:356] "Generic (PLEG): container finished" podID="715889a5-a2b1-421e-85ae-a546afcbab11" containerID="47a89b97424e599c08263d2c2e9a7193991b582babbf953daf1347c6a4b811cc" exitCode=0 Jun 03 23:25:16.813845 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:16.813813 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerDied","Data":"47a89b97424e599c08263d2c2e9a7193991b582babbf953daf1347c6a4b811cc"} Jun 03 23:25:17.819396 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:17.819360 2566 generic.go:356] "Generic (PLEG): container finished" podID="715889a5-a2b1-421e-85ae-a546afcbab11" containerID="98521235388b4c056f01c664e736a08bdabe4138eccd6c8a2520bb1bc603bf9d" exitCode=0 Jun 03 23:25:17.819879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:17.819414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerDied","Data":"98521235388b4c056f01c664e736a08bdabe4138eccd6c8a2520bb1bc603bf9d"} Jun 03 23:25:18.019861 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.019834 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-117.ec2.internal" event="NodeReady" Jun 03 23:25:18.019979 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.019956 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 03 23:25:18.067749 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.067722 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fhvhv"] Jun 03 23:25:18.086768 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.086739 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mt7pc"] Jun 03 23:25:18.087086 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.087061 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.089972 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.089949 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjp8n\"" Jun 03 23:25:18.090076 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.089992 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 03 23:25:18.090434 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.090417 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 03 23:25:18.104617 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.104559 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhvhv"] Jun 03 23:25:18.104617 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.104598 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mt7pc"] Jun 03 23:25:18.104766 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.104674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.107382 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.107366 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dr65q\"" Jun 03 23:25:18.107459 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.107441 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 03 23:25:18.107733 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.107719 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 03 23:25:18.107958 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.107942 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 03 23:25:18.262929 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.262896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.263113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.262936 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79de725f-e691-444b-9cff-68ba59239f31-config-volume\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.263113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.262960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bwtp\" (UniqueName: \"kubernetes.io/projected/ec75febd-1f67-4db2-82bc-4a2a4152d84a-kube-api-access-4bwtp\") pod \"ingress-canary-mt7pc\" (UID: \"ec75febd-1f67-4db2-82bc-4a2a4152d84a\") " pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.263113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.262998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79de725f-e691-444b-9cff-68ba59239f31-tmp-dir\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.263113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.263019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64rvk\" (UniqueName: \"kubernetes.io/projected/79de725f-e691-444b-9cff-68ba59239f31-kube-api-access-64rvk\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.263113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.263064 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec75febd-1f67-4db2-82bc-4a2a4152d84a-cert\") pod \"ingress-canary-mt7pc\" (UID: \"ec75febd-1f67-4db2-82bc-4a2a4152d84a\") " pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.363492 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363420 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.363492 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363453 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79de725f-e691-444b-9cff-68ba59239f31-config-volume\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.363492 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363478 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bwtp\" (UniqueName: \"kubernetes.io/projected/ec75febd-1f67-4db2-82bc-4a2a4152d84a-kube-api-access-4bwtp\") pod \"ingress-canary-mt7pc\" (UID: \"ec75febd-1f67-4db2-82bc-4a2a4152d84a\") " pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.363739 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363516 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79de725f-e691-444b-9cff-68ba59239f31-tmp-dir\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.363739 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:18.363585 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:18.363739 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:18.363655 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:18.8636358 +0000 UTC m=+36.673142964 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:18.363739 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363682 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64rvk\" (UniqueName: \"kubernetes.io/projected/79de725f-e691-444b-9cff-68ba59239f31-kube-api-access-64rvk\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.363939 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363745 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec75febd-1f67-4db2-82bc-4a2a4152d84a-cert\") pod \"ingress-canary-mt7pc\" (UID: \"ec75febd-1f67-4db2-82bc-4a2a4152d84a\") " pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.363939 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.363843 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79de725f-e691-444b-9cff-68ba59239f31-tmp-dir\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.364135 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.364118 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/79de725f-e691-444b-9cff-68ba59239f31-config-volume\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.368204 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.368173 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ec75febd-1f67-4db2-82bc-4a2a4152d84a-cert\") pod \"ingress-canary-mt7pc\" (UID: \"ec75febd-1f67-4db2-82bc-4a2a4152d84a\") " pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.375797 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.375769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64rvk\" (UniqueName: \"kubernetes.io/projected/79de725f-e691-444b-9cff-68ba59239f31-kube-api-access-64rvk\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.376011 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.375989 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bwtp\" (UniqueName: \"kubernetes.io/projected/ec75febd-1f67-4db2-82bc-4a2a4152d84a-kube-api-access-4bwtp\") pod \"ingress-canary-mt7pc\" (UID: \"ec75febd-1f67-4db2-82bc-4a2a4152d84a\") " pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.412923 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.412894 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mt7pc" Jun 03 23:25:18.579118 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.579087 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mt7pc"] Jun 03 23:25:18.582995 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:25:18.582970 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec75febd_1f67_4db2_82bc_4a2a4152d84a.slice/crio-038047e82955d0ab73767eaf623ad202ab471971100eb74c69daea614e707d92 WatchSource:0}: Error finding container 038047e82955d0ab73767eaf623ad202ab471971100eb74c69daea614e707d92: Status 404 returned error can't find the container with id 038047e82955d0ab73767eaf623ad202ab471971100eb74c69daea614e707d92 Jun 03 23:25:18.654405 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.654351 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:18.654510 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.654351 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:18.654567 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.654357 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:18.657608 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.657584 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:25:18.658908 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.658887 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:25:18.659047 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.659028 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:25:18.659101 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.659046 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mf7x\"" Jun 03 23:25:18.659461 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.659164 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:25:18.662346 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.659589 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9b5l\"" Jun 03 23:25:18.825723 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.825688 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" event={"ID":"715889a5-a2b1-421e-85ae-a546afcbab11","Type":"ContainerStarted","Data":"6fedc566bd5f035f10e575c8e674427423fa72b4d90b32aba2c6e5f5a05f19e1"} Jun 03 23:25:18.826937 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.826914 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mt7pc" event={"ID":"ec75febd-1f67-4db2-82bc-4a2a4152d84a","Type":"ContainerStarted","Data":"038047e82955d0ab73767eaf623ad202ab471971100eb74c69daea614e707d92"} Jun 03 23:25:18.851520 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.851482 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zpsb8" podStartSLOduration=8.673634238 podStartE2EDuration="36.851469973s" totalImagesPullingTime="28.177835735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:18.849618521 +0000 UTC m=+36.659125715" watchObservedRunningTime="2026-06-03 23:25:18.851469973 +0000 UTC m=+36.660977153" Jun 03 23:25:18.868298 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:18.868275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:18.868432 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:18.868416 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:18.868493 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:18.868483 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:19.868469642 +0000 UTC m=+37.677976801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:19.876781 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:19.876545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:19.877218 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:19.876713 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:19.877218 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:19.876875 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:21.876855585 +0000 UTC m=+39.686362757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:20.832921 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:20.832883 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mt7pc" event={"ID":"ec75febd-1f67-4db2-82bc-4a2a4152d84a","Type":"ContainerStarted","Data":"5f297eed61dba04aec9e72325857ab25900ac1a167b4d0294415366020460570"} Jun 03 23:25:20.853578 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:20.853537 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mt7pc" podStartSLOduration=1.086902591 podStartE2EDuration="2.853523992s" totalImagesPullingTime="1.766621401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:20.852779992 +0000 UTC m=+38.662287175" watchObservedRunningTime="2026-06-03 23:25:20.853523992 +0000 UTC m=+38.663031172" Jun 03 23:25:21.891465 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:21.891433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:21.892051 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:21.891604 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:21.892051 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:21.891676 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:25.89166009 +0000 UTC m=+43.701167262 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:25.918076 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:25.918041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:25.918588 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:25.918181 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:25.918588 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:25.918243 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:33.918227969 +0000 UTC m=+51.727735130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:33.971475 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:33.971430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:33.971913 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:33.971549 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:33.971913 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:33.971598 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:25:49.9715834 +0000 UTC m=+67.781090559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:42.812220 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:42.812184 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c86qb" Jun 03 23:25:48.465940 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.465896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:25:48.466386 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.465966 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:48.466386 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.465996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:48.469020 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.468999 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 03 23:25:48.469245 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.469228 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 03 23:25:48.469285 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.469245 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 03 23:25:48.476694 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:48.476672 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 23:25:48.476813 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:48.476724 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:26:52.476708232 +0000 UTC m=+130.286215391 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : secret "metrics-daemon-secret" not found Jun 03 23:25:48.479176 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.479148 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 03 23:25:48.480160 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.480142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/31e2628b-4f0f-48ae-84b4-ca683ad68476-original-pull-secret\") pod \"global-pull-secret-syncer-2qcrt\" (UID: \"31e2628b-4f0f-48ae-84b4-ca683ad68476\") " pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:48.489470 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.489444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sv2k\" (UniqueName: \"kubernetes.io/projected/1f28d85f-494f-495d-a12c-492e2c2145d9-kube-api-access-7sv2k\") pod \"network-check-target-f4n8s\" (UID: \"1f28d85f-494f-495d-a12c-492e2c2145d9\") " pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:48.671214 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.671185 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2qcrt" Jun 03 23:25:48.680232 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.680209 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f9b5l\"" Jun 03 23:25:48.687824 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.687801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:48.800772 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.800745 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2qcrt"] Jun 03 23:25:48.803920 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:25:48.803881 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e2628b_4f0f_48ae_84b4_ca683ad68476.slice/crio-c7343357455d4d457d269bad3e542efa39a76dfa6b70b52eff80674d38b73ca4 WatchSource:0}: Error finding container c7343357455d4d457d269bad3e542efa39a76dfa6b70b52eff80674d38b73ca4: Status 404 returned error can't find the container with id c7343357455d4d457d269bad3e542efa39a76dfa6b70b52eff80674d38b73ca4 Jun 03 23:25:48.814042 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.814017 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f4n8s"] Jun 03 23:25:48.816401 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:25:48.816376 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f28d85f_494f_495d_a12c_492e2c2145d9.slice/crio-391911b9674ee66df9d0dcbdeac13211b845d9d634caecb3c4e840fb10150133 WatchSource:0}: Error finding container 391911b9674ee66df9d0dcbdeac13211b845d9d634caecb3c4e840fb10150133: Status 404 returned error can't find the container with id 391911b9674ee66df9d0dcbdeac13211b845d9d634caecb3c4e840fb10150133 Jun 03 23:25:48.895216 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.895188 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4n8s" event={"ID":"1f28d85f-494f-495d-a12c-492e2c2145d9","Type":"ContainerStarted","Data":"391911b9674ee66df9d0dcbdeac13211b845d9d634caecb3c4e840fb10150133"} Jun 03 23:25:48.896286 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:48.896266 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2qcrt" event={"ID":"31e2628b-4f0f-48ae-84b4-ca683ad68476","Type":"ContainerStarted","Data":"c7343357455d4d457d269bad3e542efa39a76dfa6b70b52eff80674d38b73ca4"} Jun 03 23:25:49.974277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:49.974131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:25:49.974277 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:49.974274 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:25:49.974857 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:25:49.974361 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:26:21.974339777 +0000 UTC m=+99.783846950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:25:53.911099 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:53.911061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f4n8s" event={"ID":"1f28d85f-494f-495d-a12c-492e2c2145d9","Type":"ContainerStarted","Data":"e8983a66c1c7e5be1729f6a5a7b6141df7e957ed5c84eae0537e0739f62dbb6e"} Jun 03 23:25:53.911552 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:53.911202 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:25:53.912615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:53.912593 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2qcrt" event={"ID":"31e2628b-4f0f-48ae-84b4-ca683ad68476","Type":"ContainerStarted","Data":"17084cd8d041bbeda5b8f2d25501f03732e435d81598601fe5884a68d706be48"} Jun 03 23:25:53.928448 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:53.928404 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f4n8s" podStartSLOduration=67.62387701 podStartE2EDuration="1m11.928393053s" totalImagesPullingTime="4.304516043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:53.927657536 +0000 UTC m=+71.737164716" watchObservedRunningTime="2026-06-03 23:25:53.928393053 +0000 UTC m=+71.737900233" Jun 03 23:25:53.942489 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:25:53.942441 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2qcrt" podStartSLOduration=67.621384909 podStartE2EDuration="1m11.942426006s" totalImagesPullingTime="4.321041097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:25:53.942270648 +0000 UTC m=+71.751777844" watchObservedRunningTime="2026-06-03 23:25:53.942426006 +0000 UTC m=+71.751933167" Jun 03 23:26:21.987627 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:26:21.987578 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:26:21.988080 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:26:21.987720 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:26:21.988080 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:26:21.987781 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:27:25.98776677 +0000 UTC m=+163.797273929 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:26:24.918344 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:26:24.918298 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f4n8s" Jun 03 23:26:52.476894 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:26:52.476855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:26:52.477373 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:26:52.477011 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 03 23:26:52.477373 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:26:52.477089 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs podName:f01bf8bc-e700-4f9d-a0a6-ec6fd463464f nodeName:}" failed. No retries permitted until 2026-06-03 23:28:54.477072307 +0000 UTC m=+252.286579465 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs") pod "network-metrics-daemon-hqhlq" (UID: "f01bf8bc-e700-4f9d-a0a6-ec6fd463464f") : secret "metrics-daemon-secret" not found Jun 03 23:27:21.095957 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:27:21.095918 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fhvhv" podUID="79de725f-e691-444b-9cff-68ba59239f31" Jun 03 23:27:21.114758 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:27:21.114739 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhvhv" Jun 03 23:27:21.666570 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:27:21.666530 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hqhlq" podUID="f01bf8bc-e700-4f9d-a0a6-ec6fd463464f" Jun 03 23:27:25.993834 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:27:25.993793 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:27:25.994347 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:27:25.993942 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 03 23:27:25.994347 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:27:25.994005 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls podName:79de725f-e691-444b-9cff-68ba59239f31 nodeName:}" failed. No retries permitted until 2026-06-03 23:29:27.993989075 +0000 UTC m=+285.803496234 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls") pod "dns-default-fhvhv" (UID: "79de725f-e691-444b-9cff-68ba59239f31") : secret "dns-default-metrics-tls" not found Jun 03 23:27:35.654271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:27:35.654238 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:28:33.090120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.090091 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd"] Jun 03 23:28:33.091825 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.091810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" Jun 03 23:28:33.094263 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.094243 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-jcbzl\"" Jun 03 23:28:33.099574 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.099554 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-6ltqs"] Jun 03 23:28:33.101652 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.101635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.102217 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.102196 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd"] Jun 03 23:28:33.104040 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.104019 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7ldz9\"" Jun 03 23:28:33.104143 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.104124 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 03 23:28:33.104201 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.104126 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 03 23:28:33.113941 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.113918 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-6ltqs"] Jun 03 23:28:33.142964 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.142937 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.143089 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.142977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d207115-2859-4ca8-895b-50e9c6d01ab9-nginx-conf\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.143089 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.143028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7ql\" (UniqueName: \"kubernetes.io/projected/ddebef64-3a34-40ac-a1c8-87b841097998-kube-api-access-wd7ql\") pod \"network-check-source-dbd9cf844-2f7zd\" (UID: \"ddebef64-3a34-40ac-a1c8-87b841097998\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" Jun 03 23:28:33.196129 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.196102 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n"] Jun 03 23:28:33.198303 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.198282 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-jhd7b"] Jun 03 23:28:33.198445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.198422 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.200015 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.199998 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h"] Jun 03 23:28:33.200139 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.200123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.205959 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.205868 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.228364 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.228340 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 03 23:28:33.228471 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.228386 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.228639 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.228624 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9llv7\"" Jun 03 23:28:33.229627 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.229613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 03 23:28:33.230713 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.230696 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.233401 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.233385 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.233486 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.233452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-glrl7\"" Jun 03 23:28:33.233486 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.233459 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.236589 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.236574 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-p79kc\"" Jun 03 23:28:33.236680 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.236664 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 03 23:28:33.236718 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.236682 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 03 23:28:33.236897 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.236885 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 03 23:28:33.238391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.238371 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 03 23:28:33.240576 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.240557 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n"] Jun 03 23:28:33.243923 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.243901 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.244021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.243933 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d207115-2859-4ca8-895b-50e9c6d01ab9-nginx-conf\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.244021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.243950 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ct24\" (UniqueName: \"kubernetes.io/projected/45b6d666-7ff9-47d6-a190-45795355da74-kube-api-access-5ct24\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.244021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244015 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsl4h\" (UniqueName: \"kubernetes.io/projected/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-kube-api-access-gsl4h\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.244168 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244129 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-config\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.244168 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7ql\" (UniqueName: \"kubernetes.io/projected/ddebef64-3a34-40ac-a1c8-87b841097998-kube-api-access-wd7ql\") pod \"network-check-source-dbd9cf844-2f7zd\" (UID: \"ddebef64-3a34-40ac-a1c8-87b841097998\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" Jun 03 23:28:33.244261 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.244261 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6008800-6718-4bcc-972d-722eff0cbdd4-serving-cert\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.244261 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244226 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzww\" (UniqueName: \"kubernetes.io/projected/d6008800-6718-4bcc-972d-722eff0cbdd4-kube-api-access-jfzww\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.244261 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-serving-cert\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.244475 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244277 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6008800-6718-4bcc-972d-722eff0cbdd4-config\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.244475 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.244288 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:28:33.244475 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-trusted-ca\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.244475 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.244360 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert podName:8d207115-2859-4ca8-895b-50e9c6d01ab9 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:33.744341995 +0000 UTC m=+231.553849159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-6ltqs" (UID: "8d207115-2859-4ca8-895b-50e9c6d01ab9") : secret "networking-console-plugin-cert" not found Jun 03 23:28:33.244739 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.244722 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8d207115-2859-4ca8-895b-50e9c6d01ab9-nginx-conf\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.256603 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.256583 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-jhd7b"] Jun 03 23:28:33.265945 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.265920 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7ql\" (UniqueName: \"kubernetes.io/projected/ddebef64-3a34-40ac-a1c8-87b841097998-kube-api-access-wd7ql\") pod \"network-check-source-dbd9cf844-2f7zd\" (UID: \"ddebef64-3a34-40ac-a1c8-87b841097998\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" Jun 03 23:28:33.266446 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.266433 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:28:33.275480 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.275462 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 03 23:28:33.284794 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.284774 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h"] Jun 03 23:28:33.344882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.344804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-trusted-ca\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.344882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.344844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.344882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.344876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ct24\" (UniqueName: \"kubernetes.io/projected/45b6d666-7ff9-47d6-a190-45795355da74-kube-api-access-5ct24\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.345102 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.344931 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsl4h\" (UniqueName: \"kubernetes.io/projected/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-kube-api-access-gsl4h\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.345102 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.344965 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:28:33.345102 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.344982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-config\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.345102 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.345045 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls podName:45b6d666-7ff9-47d6-a190-45795355da74 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:33.845026183 +0000 UTC m=+231.654533355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jbm9n" (UID: "45b6d666-7ff9-47d6-a190-45795355da74") : secret "samples-operator-tls" not found Jun 03 23:28:33.345102 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.345061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6008800-6718-4bcc-972d-722eff0cbdd4-serving-cert\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.345102 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.345088 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzww\" (UniqueName: \"kubernetes.io/projected/d6008800-6718-4bcc-972d-722eff0cbdd4-kube-api-access-jfzww\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.345422 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.345111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-serving-cert\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.345422 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.345143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6008800-6718-4bcc-972d-722eff0cbdd4-config\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.345770 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.345749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d6008800-6718-4bcc-972d-722eff0cbdd4-config\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.345829 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.345749 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-config\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.346769 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.346745 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-trusted-ca\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.347594 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.347566 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d6008800-6718-4bcc-972d-722eff0cbdd4-serving-cert\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.347695 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.347607 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-serving-cert\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.361453 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.361424 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsl4h\" (UniqueName: \"kubernetes.io/projected/acb82da1-1d5b-4d7c-bc8f-75a807c7774e-kube-api-access-gsl4h\") pod \"console-operator-85bd8fd97d-jhd7b\" (UID: \"acb82da1-1d5b-4d7c-bc8f-75a807c7774e\") " pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.361649 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.361627 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzww\" (UniqueName: \"kubernetes.io/projected/d6008800-6718-4bcc-972d-722eff0cbdd4-kube-api-access-jfzww\") pod \"service-ca-operator-5bc4cf794b-jpw7h\" (UID: \"d6008800-6718-4bcc-972d-722eff0cbdd4\") " pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.361721 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.361705 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ct24\" (UniqueName: \"kubernetes.io/projected/45b6d666-7ff9-47d6-a190-45795355da74-kube-api-access-5ct24\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.400966 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.400941 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" Jun 03 23:28:33.514828 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.514795 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:33.519226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.519204 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd"] Jun 03 23:28:33.520229 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.520098 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" Jun 03 23:28:33.522631 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:33.522607 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddebef64_3a34_40ac_a1c8_87b841097998.slice/crio-f357674c3da412943c73793bad51e0a3eb733f243f9a02e279be0f5a55da3fc2 WatchSource:0}: Error finding container f357674c3da412943c73793bad51e0a3eb733f243f9a02e279be0f5a55da3fc2: Status 404 returned error can't find the container with id f357674c3da412943c73793bad51e0a3eb733f243f9a02e279be0f5a55da3fc2 Jun 03 23:28:33.652548 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.652525 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85bd8fd97d-jhd7b"] Jun 03 23:28:33.655167 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:33.655144 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb82da1_1d5b_4d7c_bc8f_75a807c7774e.slice/crio-c5a8ed5f78cd51b012037003ced8769813f6391d86ec440a899ac040c5a41df7 WatchSource:0}: Error finding container c5a8ed5f78cd51b012037003ced8769813f6391d86ec440a899ac040c5a41df7: Status 404 returned error can't find the container with id c5a8ed5f78cd51b012037003ced8769813f6391d86ec440a899ac040c5a41df7 Jun 03 23:28:33.672200 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.672173 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h"] Jun 03 23:28:33.674951 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:33.674929 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6008800_6718_4bcc_972d_722eff0cbdd4.slice/crio-f1fe86d7fbaa19ff258f2ccfe2a640f9fa873060dbaa0ed64363d81318d7e3f3 WatchSource:0}: Error finding container f1fe86d7fbaa19ff258f2ccfe2a640f9fa873060dbaa0ed64363d81318d7e3f3: Status 404 returned error can't find the container with id f1fe86d7fbaa19ff258f2ccfe2a640f9fa873060dbaa0ed64363d81318d7e3f3 Jun 03 23:28:33.748897 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.748869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:33.749028 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.748973 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:28:33.749028 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.749022 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert podName:8d207115-2859-4ca8-895b-50e9c6d01ab9 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:34.749008399 +0000 UTC m=+232.558515559 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-6ltqs" (UID: "8d207115-2859-4ca8-895b-50e9c6d01ab9") : secret "networking-console-plugin-cert" not found Jun 03 23:28:33.849296 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:33.849264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:33.849462 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.849443 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:28:33.849517 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:33.849508 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls podName:45b6d666-7ff9-47d6-a190-45795355da74 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:34.849490846 +0000 UTC m=+232.658998007 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jbm9n" (UID: "45b6d666-7ff9-47d6-a190-45795355da74") : secret "samples-operator-tls" not found Jun 03 23:28:34.285279 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.285190 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" event={"ID":"d6008800-6718-4bcc-972d-722eff0cbdd4","Type":"ContainerStarted","Data":"f1fe86d7fbaa19ff258f2ccfe2a640f9fa873060dbaa0ed64363d81318d7e3f3"} Jun 03 23:28:34.287891 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.287789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" event={"ID":"ddebef64-3a34-40ac-a1c8-87b841097998","Type":"ContainerStarted","Data":"005f21273ae816bfe2362e74e63323ca2d4e9c818b1293f55cda2791fbf4bdc7"} Jun 03 23:28:34.287891 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.287860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" event={"ID":"ddebef64-3a34-40ac-a1c8-87b841097998","Type":"ContainerStarted","Data":"f357674c3da412943c73793bad51e0a3eb733f243f9a02e279be0f5a55da3fc2"} Jun 03 23:28:34.289300 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.289276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" event={"ID":"acb82da1-1d5b-4d7c-bc8f-75a807c7774e","Type":"ContainerStarted","Data":"c5a8ed5f78cd51b012037003ced8769813f6391d86ec440a899ac040c5a41df7"} Jun 03 23:28:34.305648 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.305597 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-2f7zd" podStartSLOduration=1.305578788 podStartE2EDuration="1.305578788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:34.305465808 +0000 UTC m=+232.114972991" watchObservedRunningTime="2026-06-03 23:28:34.305578788 +0000 UTC m=+232.115085971" Jun 03 23:28:34.758100 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.758019 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:34.758313 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:34.758184 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:28:34.758313 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:34.758273 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert podName:8d207115-2859-4ca8-895b-50e9c6d01ab9 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:36.758251738 +0000 UTC m=+234.567758902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-6ltqs" (UID: "8d207115-2859-4ca8-895b-50e9c6d01ab9") : secret "networking-console-plugin-cert" not found Jun 03 23:28:34.859443 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:34.859390 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:34.859600 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:34.859545 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:28:34.859637 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:34.859608 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls podName:45b6d666-7ff9-47d6-a190-45795355da74 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:36.859593435 +0000 UTC m=+234.669100594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jbm9n" (UID: "45b6d666-7ff9-47d6-a190-45795355da74") : secret "samples-operator-tls" not found Jun 03 23:28:36.301021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.300981 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" event={"ID":"d6008800-6718-4bcc-972d-722eff0cbdd4","Type":"ContainerStarted","Data":"bcf428ea63efe73e1483920d844c896daf5279c7bb4988dbc866a1535a9060fb"} Jun 03 23:28:36.302604 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.302586 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/0.log" Jun 03 23:28:36.302724 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.302622 2566 generic.go:356] "Generic (PLEG): container finished" podID="acb82da1-1d5b-4d7c-bc8f-75a807c7774e" containerID="5c20dbbc00a6bf8e0ef8716d5d106b8fcb198898843324ac4e29a195c051fd9a" exitCode=255 Jun 03 23:28:36.302724 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.302656 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" event={"ID":"acb82da1-1d5b-4d7c-bc8f-75a807c7774e","Type":"ContainerDied","Data":"5c20dbbc00a6bf8e0ef8716d5d106b8fcb198898843324ac4e29a195c051fd9a"} Jun 03 23:28:36.302835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.302828 2566 scope.go:117] "RemoveContainer" containerID="5c20dbbc00a6bf8e0ef8716d5d106b8fcb198898843324ac4e29a195c051fd9a" Jun 03 23:28:36.319586 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.319534 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" podStartSLOduration=1.129242308 podStartE2EDuration="3.319515544s" totalImagesPullingTime="2.190273236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:36.318747806 +0000 UTC m=+234.128254988" watchObservedRunningTime="2026-06-03 23:28:36.319515544 +0000 UTC m=+234.129022726" Jun 03 23:28:36.775375 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.775316 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:36.775554 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:36.775455 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:28:36.775554 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:36.775523 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert podName:8d207115-2859-4ca8-895b-50e9c6d01ab9 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:40.775506441 +0000 UTC m=+238.585013602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-6ltqs" (UID: "8d207115-2859-4ca8-895b-50e9c6d01ab9") : secret "networking-console-plugin-cert" not found Jun 03 23:28:36.876209 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:36.876180 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:36.876393 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:36.876372 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 03 23:28:36.876493 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:36.876451 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls podName:45b6d666-7ff9-47d6-a190-45795355da74 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:40.876430738 +0000 UTC m=+238.685937922 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls") pod "cluster-samples-operator-9f6f677f5-jbm9n" (UID: "45b6d666-7ff9-47d6-a190-45795355da74") : secret "samples-operator-tls" not found Jun 03 23:28:37.307190 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.307165 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:28:37.307577 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.307553 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/0.log" Jun 03 23:28:37.307618 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.307588 2566 generic.go:356] "Generic (PLEG): container finished" podID="acb82da1-1d5b-4d7c-bc8f-75a807c7774e" containerID="2d33a726568317126ad445d9a03acc1b81b7e2cd52014b815738a8c9f5f70d07" exitCode=255 Jun 03 23:28:37.307698 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.307678 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" event={"ID":"acb82da1-1d5b-4d7c-bc8f-75a807c7774e","Type":"ContainerDied","Data":"2d33a726568317126ad445d9a03acc1b81b7e2cd52014b815738a8c9f5f70d07"} Jun 03 23:28:37.307747 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.307733 2566 scope.go:117] "RemoveContainer" containerID="5c20dbbc00a6bf8e0ef8716d5d106b8fcb198898843324ac4e29a195c051fd9a" Jun 03 23:28:37.307947 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.307929 2566 scope.go:117] "RemoveContainer" containerID="2d33a726568317126ad445d9a03acc1b81b7e2cd52014b815738a8c9f5f70d07" Jun 03 23:28:37.308127 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:37.308106 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jhd7b_openshift-console-operator(acb82da1-1d5b-4d7c-bc8f-75a807c7774e)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" podUID="acb82da1-1d5b-4d7c-bc8f-75a807c7774e" Jun 03 23:28:37.387208 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.387180 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6"] Jun 03 23:28:37.391163 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.391145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" Jun 03 23:28:37.393885 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.393859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 03 23:28:37.393997 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.393921 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sww2j\"" Jun 03 23:28:37.394060 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.394016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 03 23:28:37.401088 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.401061 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6"] Jun 03 23:28:37.481504 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.481464 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hxv7\" (UniqueName: \"kubernetes.io/projected/38e4dc4f-72a0-4041-a06e-6cadcdc99463-kube-api-access-4hxv7\") pod \"migrator-955ffdf5f-7m8n6\" (UID: \"38e4dc4f-72a0-4041-a06e-6cadcdc99463\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" Jun 03 23:28:37.582246 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.582159 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hxv7\" (UniqueName: \"kubernetes.io/projected/38e4dc4f-72a0-4041-a06e-6cadcdc99463-kube-api-access-4hxv7\") pod \"migrator-955ffdf5f-7m8n6\" (UID: \"38e4dc4f-72a0-4041-a06e-6cadcdc99463\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" Jun 03 23:28:37.590584 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.590556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hxv7\" (UniqueName: \"kubernetes.io/projected/38e4dc4f-72a0-4041-a06e-6cadcdc99463-kube-api-access-4hxv7\") pod \"migrator-955ffdf5f-7m8n6\" (UID: \"38e4dc4f-72a0-4041-a06e-6cadcdc99463\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" Jun 03 23:28:37.700243 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.700219 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" Jun 03 23:28:37.824926 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:37.824896 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6"] Jun 03 23:28:37.827652 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:37.827627 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38e4dc4f_72a0_4041_a06e_6cadcdc99463.slice/crio-d9fa374f49a7a8614580b3ee559babbec29eb63be2678c9f304f92dbc015f835 WatchSource:0}: Error finding container d9fa374f49a7a8614580b3ee559babbec29eb63be2678c9f304f92dbc015f835: Status 404 returned error can't find the container with id d9fa374f49a7a8614580b3ee559babbec29eb63be2678c9f304f92dbc015f835 Jun 03 23:28:38.312071 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:38.312023 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" event={"ID":"38e4dc4f-72a0-4041-a06e-6cadcdc99463","Type":"ContainerStarted","Data":"d9fa374f49a7a8614580b3ee559babbec29eb63be2678c9f304f92dbc015f835"} Jun 03 23:28:38.313496 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:38.313478 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:28:38.313791 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:38.313775 2566 scope.go:117] "RemoveContainer" containerID="2d33a726568317126ad445d9a03acc1b81b7e2cd52014b815738a8c9f5f70d07" Jun 03 23:28:38.313936 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:38.313919 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jhd7b_openshift-console-operator(acb82da1-1d5b-4d7c-bc8f-75a807c7774e)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" podUID="acb82da1-1d5b-4d7c-bc8f-75a807c7774e" Jun 03 23:28:38.682276 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:38.682208 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrxwn_09f479cf-da5a-486c-8a55-e1c747cca628/dns-node-resolver/0.log" Jun 03 23:28:39.011837 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.011807 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-hth8z"] Jun 03 23:28:39.015998 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.015975 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.018934 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.018917 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 03 23:28:39.019134 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.019121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 03 23:28:39.019342 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.019310 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 03 23:28:39.020258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.020245 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 03 23:28:39.020431 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.020415 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-psh64\"" Jun 03 23:28:39.030731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.030566 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-hth8z"] Jun 03 23:28:39.095439 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.095412 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df85788e-31f0-42e3-bb64-74d0920f79ea-signing-key\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.095549 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.095462 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59sz5\" (UniqueName: \"kubernetes.io/projected/df85788e-31f0-42e3-bb64-74d0920f79ea-kube-api-access-59sz5\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.095591 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.095560 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df85788e-31f0-42e3-bb64-74d0920f79ea-signing-cabundle\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.196586 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.196508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59sz5\" (UniqueName: \"kubernetes.io/projected/df85788e-31f0-42e3-bb64-74d0920f79ea-kube-api-access-59sz5\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.196586 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.196584 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df85788e-31f0-42e3-bb64-74d0920f79ea-signing-cabundle\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.196758 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.196633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df85788e-31f0-42e3-bb64-74d0920f79ea-signing-key\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.197228 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.197204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/df85788e-31f0-42e3-bb64-74d0920f79ea-signing-cabundle\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.199123 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.199102 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/df85788e-31f0-42e3-bb64-74d0920f79ea-signing-key\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.209044 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.209020 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59sz5\" (UniqueName: \"kubernetes.io/projected/df85788e-31f0-42e3-bb64-74d0920f79ea-kube-api-access-59sz5\") pod \"service-ca-7d74d578b8-hth8z\" (UID: \"df85788e-31f0-42e3-bb64-74d0920f79ea\") " pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.318313 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.318276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" event={"ID":"38e4dc4f-72a0-4041-a06e-6cadcdc99463","Type":"ContainerStarted","Data":"ba402e18cc7708b5250f4c2bb8d736f43a6c155125fa15de3b356a7b4b884872"} Jun 03 23:28:39.318684 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.318350 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" event={"ID":"38e4dc4f-72a0-4041-a06e-6cadcdc99463","Type":"ContainerStarted","Data":"0b13ad9a7908c2829ffbcc602db8af7c41bef3eec2a594c5ab32a8af8cfd1bd9"} Jun 03 23:28:39.334971 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.334949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" Jun 03 23:28:39.339587 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.339538 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-7m8n6" podStartSLOduration=1.258653824 podStartE2EDuration="2.339519416s" totalImagesPullingTime="1.080865592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:39.338739354 +0000 UTC m=+237.148246536" watchObservedRunningTime="2026-06-03 23:28:39.339519416 +0000 UTC m=+237.149026599" Jun 03 23:28:39.459311 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.459277 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-hth8z"] Jun 03 23:28:39.463266 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:39.463239 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf85788e_31f0_42e3_bb64_74d0920f79ea.slice/crio-ff4ce86b67a69eba13ecb78682bf5d0dd4fc7d3f4b5091ddc3d430efee83bc84 WatchSource:0}: Error finding container ff4ce86b67a69eba13ecb78682bf5d0dd4fc7d3f4b5091ddc3d430efee83bc84: Status 404 returned error can't find the container with id ff4ce86b67a69eba13ecb78682bf5d0dd4fc7d3f4b5091ddc3d430efee83bc84 Jun 03 23:28:39.485603 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:39.485584 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dm5ql_b75f0eec-6b19-4269-9880-55b6112fca1c/node-ca/0.log" Jun 03 23:28:40.284173 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.284148 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mt7pc_ec75febd-1f67-4db2-82bc-4a2a4152d84a/serve-healthcheck-canary/0.log" Jun 03 23:28:40.326124 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.326083 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" event={"ID":"df85788e-31f0-42e3-bb64-74d0920f79ea","Type":"ContainerStarted","Data":"f8eebba3743b295df6341c33f9be14b7b2ddde1b2a67dbd933a1689776cb5a14"} Jun 03 23:28:40.326596 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.326137 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" event={"ID":"df85788e-31f0-42e3-bb64-74d0920f79ea","Type":"ContainerStarted","Data":"ff4ce86b67a69eba13ecb78682bf5d0dd4fc7d3f4b5091ddc3d430efee83bc84"} Jun 03 23:28:40.348146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.348076 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-hth8z" podStartSLOduration=2.348048699 podStartE2EDuration="2.348048699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:40.34676642 +0000 UTC m=+238.156273604" watchObservedRunningTime="2026-06-03 23:28:40.348048699 +0000 UTC m=+238.157555880" Jun 03 23:28:40.810559 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.810457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:40.810762 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:40.810628 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 03 23:28:40.810762 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:40.810710 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert podName:8d207115-2859-4ca8-895b-50e9c6d01ab9 nodeName:}" failed. No retries permitted until 2026-06-03 23:28:48.81068864 +0000 UTC m=+246.620195806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert") pod "networking-console-plugin-68d6b54856-6ltqs" (UID: "8d207115-2859-4ca8-895b-50e9c6d01ab9") : secret "networking-console-plugin-cert" not found Jun 03 23:28:40.911342 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.911294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:40.914113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:40.914088 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/45b6d666-7ff9-47d6-a190-45795355da74-samples-operator-tls\") pod \"cluster-samples-operator-9f6f677f5-jbm9n\" (UID: \"45b6d666-7ff9-47d6-a190-45795355da74\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:41.009729 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:41.009680 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" Jun 03 23:28:41.165060 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:41.165029 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n"] Jun 03 23:28:41.329787 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:41.329695 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" event={"ID":"45b6d666-7ff9-47d6-a190-45795355da74","Type":"ContainerStarted","Data":"b2e31ccb1c045151106b951b90037c46b9f325971d9ee468d8b73ee199263915"} Jun 03 23:28:43.340619 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:43.340579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" event={"ID":"45b6d666-7ff9-47d6-a190-45795355da74","Type":"ContainerStarted","Data":"dea353fc7dd0f1607168d2dc7b62e195d453d69a86ecbaeb8e4c8208bf94809b"} Jun 03 23:28:43.341083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:43.340637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" event={"ID":"45b6d666-7ff9-47d6-a190-45795355da74","Type":"ContainerStarted","Data":"d51d63a389b2415508d3faf86f95b0cf178054d854f6ef0ec5b57d9424737436"} Jun 03 23:28:43.371452 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:43.371407 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9f6f677f5-jbm9n" podStartSLOduration=8.881589858 podStartE2EDuration="10.371393076s" totalImagesPullingTime="1.489803218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:43.371177117 +0000 UTC m=+241.180684299" watchObservedRunningTime="2026-06-03 23:28:43.371393076 +0000 UTC m=+241.180900258" Jun 03 23:28:43.515180 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:43.515147 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:43.515350 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:43.515199 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:43.515587 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:43.515575 2566 scope.go:117] "RemoveContainer" containerID="2d33a726568317126ad445d9a03acc1b81b7e2cd52014b815738a8c9f5f70d07" Jun 03 23:28:43.515732 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:28:43.515715 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85bd8fd97d-jhd7b_openshift-console-operator(acb82da1-1d5b-4d7c-bc8f-75a807c7774e)\"" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" podUID="acb82da1-1d5b-4d7c-bc8f-75a807c7774e" Jun 03 23:28:48.872604 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:48.872573 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:48.875685 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:48.875659 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8d207115-2859-4ca8-895b-50e9c6d01ab9-networking-console-plugin-cert\") pod \"networking-console-plugin-68d6b54856-6ltqs\" (UID: \"8d207115-2859-4ca8-895b-50e9c6d01ab9\") " pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:49.013450 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:49.013419 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-7ldz9\"" Jun 03 23:28:49.020879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:49.020854 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" Jun 03 23:28:49.141894 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:49.141826 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-68d6b54856-6ltqs"] Jun 03 23:28:49.144766 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:49.144739 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d207115_2859_4ca8_895b_50e9c6d01ab9.slice/crio-7a86a3135e61337a78ff70df5a1a641a381e183658f1a727e91ed1075174204c WatchSource:0}: Error finding container 7a86a3135e61337a78ff70df5a1a641a381e183658f1a727e91ed1075174204c: Status 404 returned error can't find the container with id 7a86a3135e61337a78ff70df5a1a641a381e183658f1a727e91ed1075174204c Jun 03 23:28:49.359359 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:49.359309 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" event={"ID":"8d207115-2859-4ca8-895b-50e9c6d01ab9","Type":"ContainerStarted","Data":"7a86a3135e61337a78ff70df5a1a641a381e183658f1a727e91ed1075174204c"} Jun 03 23:28:50.363267 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:50.363177 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" event={"ID":"8d207115-2859-4ca8-895b-50e9c6d01ab9","Type":"ContainerStarted","Data":"b3cf628e155eab91f1c7bb76a584bb67d24e474d58487aa67d0f1825f0907b36"} Jun 03 23:28:50.391646 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:50.391590 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-68d6b54856-6ltqs" podStartSLOduration=16.482314473 podStartE2EDuration="17.391576818s" totalImagesPullingTime="909.262345ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:50.390266954 +0000 UTC m=+248.199774135" watchObservedRunningTime="2026-06-03 23:28:50.391576818 +0000 UTC m=+248.201084032" Jun 03 23:28:54.511174 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:54.511144 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:28:54.513601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:54.513578 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f01bf8bc-e700-4f9d-a0a6-ec6fd463464f-metrics-certs\") pod \"network-metrics-daemon-hqhlq\" (UID: \"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f\") " pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:28:54.557369 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:54.557344 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5mf7x\"" Jun 03 23:28:54.564794 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:54.564777 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hqhlq" Jun 03 23:28:54.691460 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:54.691431 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hqhlq"] Jun 03 23:28:54.694586 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:28:54.694551 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01bf8bc_e700_4f9d_a0a6_ec6fd463464f.slice/crio-7ce70c1b1b74c7b4a732140769db6b849ae0e05ac20e1d50c3af2e49f1c4d6e4 WatchSource:0}: Error finding container 7ce70c1b1b74c7b4a732140769db6b849ae0e05ac20e1d50c3af2e49f1c4d6e4: Status 404 returned error can't find the container with id 7ce70c1b1b74c7b4a732140769db6b849ae0e05ac20e1d50c3af2e49f1c4d6e4 Jun 03 23:28:55.378823 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:55.378786 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hqhlq" event={"ID":"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f","Type":"ContainerStarted","Data":"7ce70c1b1b74c7b4a732140769db6b849ae0e05ac20e1d50c3af2e49f1c4d6e4"} Jun 03 23:28:56.384032 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:56.383998 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hqhlq" event={"ID":"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f","Type":"ContainerStarted","Data":"92df8920032f9cabb3950acc739f87ad32ea873f11b3be24178774475f6f2ecc"} Jun 03 23:28:56.384417 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:56.384108 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hqhlq" event={"ID":"f01bf8bc-e700-4f9d-a0a6-ec6fd463464f","Type":"ContainerStarted","Data":"1ea225124dc5411f4f5bae9bcbf4f9a7ec8bcdb14fb706610eafad679084af3e"} Jun 03 23:28:56.401726 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:56.401679 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hqhlq" podStartSLOduration=253.510137934 podStartE2EDuration="4m14.40166544s" totalImagesPullingTime="891.527506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:56.400660359 +0000 UTC m=+254.210167539" watchObservedRunningTime="2026-06-03 23:28:56.40166544 +0000 UTC m=+254.211172634" Jun 03 23:28:57.654391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:57.654365 2566 scope.go:117] "RemoveContainer" containerID="2d33a726568317126ad445d9a03acc1b81b7e2cd52014b815738a8c9f5f70d07" Jun 03 23:28:58.391699 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:58.391672 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:28:58.391840 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:58.391762 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" event={"ID":"acb82da1-1d5b-4d7c-bc8f-75a807c7774e","Type":"ContainerStarted","Data":"423d2e7842a122e4a4b2bb34f99f7147d32092434c9852d8ba6de11895e63478"} Jun 03 23:28:58.392039 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:58.392014 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:58.396501 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:58.396477 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" Jun 03 23:28:58.413177 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:28:58.413139 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85bd8fd97d-jhd7b" podStartSLOduration=23.204844194 podStartE2EDuration="25.413126292s" totalImagesPullingTime="2.208282098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:28:58.412435584 +0000 UTC m=+256.221942764" watchObservedRunningTime="2026-06-03 23:28:58.413126292 +0000 UTC m=+256.222633474" Jun 03 23:29:03.150341 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.150292 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-56b467f5ff-4rh2l"] Jun 03 23:29:03.153652 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.153631 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:03.156554 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.156531 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 03 23:29:03.156654 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.156599 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 03 23:29:03.157073 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.157060 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fd5td\"" Jun 03 23:29:03.173393 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.173369 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-4rh2l"] Jun 03 23:29:03.261469 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.261442 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9mxw5"] Jun 03 23:29:03.264373 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.264355 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.268555 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.268534 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 03 23:29:03.268990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.268971 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tkll5\"" Jun 03 23:29:03.269061 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.269035 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 03 23:29:03.269503 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.269467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kvx5\" (UniqueName: \"kubernetes.io/projected/e70240a6-1818-46e1-b92e-d078d7f15997-kube-api-access-7kvx5\") pod \"downloads-56b467f5ff-4rh2l\" (UID: \"e70240a6-1818-46e1-b92e-d078d7f15997\") " pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:03.269596 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.269510 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 03 23:29:03.269919 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.269905 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 03 23:29:03.284128 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.284097 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9mxw5"] Jun 03 23:29:03.370214 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.370177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32741757-240b-438e-b106-8667d29968be-data-volume\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.370367 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.370224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32741757-240b-438e-b106-8667d29968be-crio-socket\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.370367 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.370246 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32741757-240b-438e-b106-8667d29968be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.370367 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.370276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kvx5\" (UniqueName: \"kubernetes.io/projected/e70240a6-1818-46e1-b92e-d078d7f15997-kube-api-access-7kvx5\") pod \"downloads-56b467f5ff-4rh2l\" (UID: \"e70240a6-1818-46e1-b92e-d078d7f15997\") " pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:03.370367 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.370334 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcz85\" (UniqueName: \"kubernetes.io/projected/32741757-240b-438e-b106-8667d29968be-kube-api-access-fcz85\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.370519 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.370389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32741757-240b-438e-b106-8667d29968be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.383225 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.383195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kvx5\" (UniqueName: \"kubernetes.io/projected/e70240a6-1818-46e1-b92e-d078d7f15997-kube-api-access-7kvx5\") pod \"downloads-56b467f5ff-4rh2l\" (UID: \"e70240a6-1818-46e1-b92e-d078d7f15997\") " pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:03.462449 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.462421 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:03.471272 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471246 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32741757-240b-438e-b106-8667d29968be-data-volume\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471376 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32741757-240b-438e-b106-8667d29968be-crio-socket\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471376 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32741757-240b-438e-b106-8667d29968be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471466 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32741757-240b-438e-b106-8667d29968be-crio-socket\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471466 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcz85\" (UniqueName: \"kubernetes.io/projected/32741757-240b-438e-b106-8667d29968be-kube-api-access-fcz85\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471565 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471475 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32741757-240b-438e-b106-8667d29968be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32741757-240b-438e-b106-8667d29968be-data-volume\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.471960 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.471935 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32741757-240b-438e-b106-8667d29968be-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.473779 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.473754 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32741757-240b-438e-b106-8667d29968be-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.483665 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.483642 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcz85\" (UniqueName: \"kubernetes.io/projected/32741757-240b-438e-b106-8667d29968be-kube-api-access-fcz85\") pod \"insights-runtime-extractor-9mxw5\" (UID: \"32741757-240b-438e-b106-8667d29968be\") " pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.573458 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.573434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9mxw5" Jun 03 23:29:03.621721 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.621698 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-56b467f5ff-4rh2l"] Jun 03 23:29:03.624779 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:03.624686 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode70240a6_1818_46e1_b92e_d078d7f15997.slice/crio-d212a4a8b74413542f6b9ff2730a28b789a75c78a5ddca13f9e12756662f7cfc WatchSource:0}: Error finding container d212a4a8b74413542f6b9ff2730a28b789a75c78a5ddca13f9e12756662f7cfc: Status 404 returned error can't find the container with id d212a4a8b74413542f6b9ff2730a28b789a75c78a5ddca13f9e12756662f7cfc Jun 03 23:29:03.714527 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:03.714496 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9mxw5"] Jun 03 23:29:03.717068 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:03.717035 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32741757_240b_438e_b106_8667d29968be.slice/crio-6a6be59482e4d7e4fa0068d9c15ea27ee476cc9116d375c5b535487baf24488c WatchSource:0}: Error finding container 6a6be59482e4d7e4fa0068d9c15ea27ee476cc9116d375c5b535487baf24488c: Status 404 returned error can't find the container with id 6a6be59482e4d7e4fa0068d9c15ea27ee476cc9116d375c5b535487baf24488c Jun 03 23:29:04.101806 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.101731 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-787bc45b48-697rx"] Jun 03 23:29:04.104608 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.104581 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.109371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.109343 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 03 23:29:04.109371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.109364 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 03 23:29:04.109570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.109436 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 03 23:29:04.110844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.110823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 03 23:29:04.110976 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.110918 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6dlps\"" Jun 03 23:29:04.110976 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.110828 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 03 23:29:04.117505 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.117481 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787bc45b48-697rx"] Jun 03 23:29:04.279204 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.279165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-service-ca\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.279689 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.279215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8ncr\" (UniqueName: \"kubernetes.io/projected/aceded00-1da4-42ca-80fe-688b28e3d679-kube-api-access-d8ncr\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.279689 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.279249 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-console-config\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.279689 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.279352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-oauth-serving-cert\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.279689 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.279437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-serving-cert\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.279689 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.279473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-oauth-config\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.380388 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.380366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-oauth-serving-cert\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.380499 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.380414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-serving-cert\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.380499 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.380430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-oauth-config\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.380619 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.380600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-service-ca\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.380668 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.380636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8ncr\" (UniqueName: \"kubernetes.io/projected/aceded00-1da4-42ca-80fe-688b28e3d679-kube-api-access-d8ncr\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.380725 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.380672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-console-config\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.381153 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.381113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-oauth-serving-cert\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.381266 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.381246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-service-ca\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.381309 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.381279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-console-config\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.382618 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.382596 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-oauth-config\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.382879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.382830 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-serving-cert\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.392625 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.392605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8ncr\" (UniqueName: \"kubernetes.io/projected/aceded00-1da4-42ca-80fe-688b28e3d679-kube-api-access-d8ncr\") pod \"console-787bc45b48-697rx\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.415001 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.414974 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:04.417233 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.417205 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mxw5" event={"ID":"32741757-240b-438e-b106-8667d29968be","Type":"ContainerStarted","Data":"0bfd60e9063917a6bf656c28200fe0d31de28e39e1cc524b0a2deb8116af0b3a"} Jun 03 23:29:04.417360 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.417296 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mxw5" event={"ID":"32741757-240b-438e-b106-8667d29968be","Type":"ContainerStarted","Data":"6cb6b53b39dbac29bc367e5a93dd923494b50a2d9f3d52f9258c7e3bcf041322"} Jun 03 23:29:04.417433 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.417369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mxw5" event={"ID":"32741757-240b-438e-b106-8667d29968be","Type":"ContainerStarted","Data":"6a6be59482e4d7e4fa0068d9c15ea27ee476cc9116d375c5b535487baf24488c"} Jun 03 23:29:04.418636 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.418614 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-4rh2l" event={"ID":"e70240a6-1818-46e1-b92e-d078d7f15997","Type":"ContainerStarted","Data":"d212a4a8b74413542f6b9ff2730a28b789a75c78a5ddca13f9e12756662f7cfc"} Jun 03 23:29:04.545386 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:04.545354 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-787bc45b48-697rx"] Jun 03 23:29:04.552086 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:04.552047 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaceded00_1da4_42ca_80fe_688b28e3d679.slice/crio-822dc545f21b940ec452661678a2e9684ce5a2da9069af7430c4ecf15101c248 WatchSource:0}: Error finding container 822dc545f21b940ec452661678a2e9684ce5a2da9069af7430c4ecf15101c248: Status 404 returned error can't find the container with id 822dc545f21b940ec452661678a2e9684ce5a2da9069af7430c4ecf15101c248 Jun 03 23:29:05.424286 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:05.424243 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787bc45b48-697rx" event={"ID":"aceded00-1da4-42ca-80fe-688b28e3d679","Type":"ContainerStarted","Data":"822dc545f21b940ec452661678a2e9684ce5a2da9069af7430c4ecf15101c248"} Jun 03 23:29:06.225361 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.225315 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-55trx"] Jun 03 23:29:06.227664 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.227593 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.230458 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.230433 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 03 23:29:06.230606 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.230487 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 03 23:29:06.231987 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.231825 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 03 23:29:06.231987 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.231850 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 03 23:29:06.231987 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.231879 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 03 23:29:06.231987 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.231952 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n64zj\"" Jun 03 23:29:06.240678 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.240656 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-55trx"] Jun 03 23:29:06.397144 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.397109 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whng\" (UniqueName: \"kubernetes.io/projected/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-kube-api-access-2whng\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.397316 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.397164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.397316 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.397208 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.397316 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.397280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.432002 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.431924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mxw5" event={"ID":"32741757-240b-438e-b106-8667d29968be","Type":"ContainerStarted","Data":"1e170f9f7b5347ee4a816990e54cd62fc7f222145dda89461e2945be5b61510a"} Jun 03 23:29:06.451608 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.451560 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9mxw5" podStartSLOduration=1.3716961429999999 podStartE2EDuration="3.45154106s" totalImagesPullingTime="2.079844917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-03 23:29:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:06.451178344 +0000 UTC m=+264.260685532" watchObservedRunningTime="2026-06-03 23:29:06.45154106 +0000 UTC m=+264.261048240" Jun 03 23:29:06.498007 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.497923 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whng\" (UniqueName: \"kubernetes.io/projected/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-kube-api-access-2whng\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.498007 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.497973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.498165 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.498015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.498165 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.498086 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.499136 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.499109 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.501440 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.501382 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.501567 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.501541 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.507911 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.507869 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whng\" (UniqueName: \"kubernetes.io/projected/95f28a93-9389-49d3-9ad2-3a0bafb69f8b-kube-api-access-2whng\") pod \"prometheus-operator-7f7d445d84-55trx\" (UID: \"95f28a93-9389-49d3-9ad2-3a0bafb69f8b\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.539131 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.538915 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" Jun 03 23:29:06.693068 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:06.693031 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-55trx"] Jun 03 23:29:07.779055 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:07.779021 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f28a93_9389_49d3_9ad2_3a0bafb69f8b.slice/crio-7c802271cd0fa708c9cadb29b48f43cfb2ad1926de517de0bedb6e137f83a66d WatchSource:0}: Error finding container 7c802271cd0fa708c9cadb29b48f43cfb2ad1926de517de0bedb6e137f83a66d: Status 404 returned error can't find the container with id 7c802271cd0fa708c9cadb29b48f43cfb2ad1926de517de0bedb6e137f83a66d Jun 03 23:29:08.442142 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:08.442098 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787bc45b48-697rx" event={"ID":"aceded00-1da4-42ca-80fe-688b28e3d679","Type":"ContainerStarted","Data":"885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647"} Jun 03 23:29:08.444289 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:08.444254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" event={"ID":"95f28a93-9389-49d3-9ad2-3a0bafb69f8b","Type":"ContainerStarted","Data":"7c802271cd0fa708c9cadb29b48f43cfb2ad1926de517de0bedb6e137f83a66d"} Jun 03 23:29:08.462929 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:08.462145 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-787bc45b48-697rx" podStartSLOduration=1.189870456 podStartE2EDuration="4.462127908s" totalImagesPullingTime="3.272257452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:08.461246715 +0000 UTC m=+266.270753908" watchObservedRunningTime="2026-06-03 23:29:08.462127908 +0000 UTC m=+266.271635091" Jun 03 23:29:09.450411 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:09.450367 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" event={"ID":"95f28a93-9389-49d3-9ad2-3a0bafb69f8b","Type":"ContainerStarted","Data":"8060f14d10e304c84c90765a402fb1907818e690df2f6acbe65a32a10e3cf2b8"} Jun 03 23:29:09.450817 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:09.450434 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" event={"ID":"95f28a93-9389-49d3-9ad2-3a0bafb69f8b","Type":"ContainerStarted","Data":"c1edd730fa1471f61a803a67daeae440e9a9cc5e6065737296f5be9a904a9328"} Jun 03 23:29:09.477001 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:09.476955 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-55trx" podStartSLOduration=2.287130386 podStartE2EDuration="3.476938884s" totalImagesPullingTime="1.189808498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:09.475095776 +0000 UTC m=+267.284602955" watchObservedRunningTime="2026-06-03 23:29:09.476938884 +0000 UTC m=+267.286446065" Jun 03 23:29:11.566346 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.566140 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4"] Jun 03 23:29:11.610513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.610457 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4"] Jun 03 23:29:11.610513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.610511 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5qwff"] Jun 03 23:29:11.610720 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.610574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.613889 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.613863 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 03 23:29:11.614120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.614105 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rq2z8\"" Jun 03 23:29:11.614283 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.614261 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 03 23:29:11.623755 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.623737 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.626497 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.626476 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 03 23:29:11.626608 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.626589 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4qqpc\"" Jun 03 23:29:11.626864 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.626848 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 03 23:29:11.626947 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.626890 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 03 23:29:11.748652 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.748820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-tls\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.748820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-root\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.748820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c961e8-3123-436b-bb52-ffa0ec350b34-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.748820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748803 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqtz\" (UniqueName: \"kubernetes.io/projected/14c961e8-3123-436b-bb52-ffa0ec350b34-kube-api-access-2xqtz\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.749023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748829 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-metrics-client-ca\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.749023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpmvq\" (UniqueName: \"kubernetes.io/projected/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-kube-api-access-tpmvq\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.749023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.749023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748935 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-sys\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.749023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.748989 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-wtmp\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.749308 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.749036 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-textfile\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.749308 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.749095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.749308 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.749144 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.850007 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.849920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.850007 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.849983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-tls\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850044 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-root\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c961e8-3123-436b-bb52-ffa0ec350b34-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:29:11.850087 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqtz\" (UniqueName: \"kubernetes.io/projected/14c961e8-3123-436b-bb52-ffa0ec350b34-kube-api-access-2xqtz\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-metrics-client-ca\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:29:11.850158 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-tls podName:14c961e8-3123-436b-bb52-ffa0ec350b34 nodeName:}" failed. No retries permitted until 2026-06-03 23:29:12.350138536 +0000 UTC m=+270.159645718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-kdlb4" (UID: "14c961e8-3123-436b-bb52-ffa0ec350b34") : secret "openshift-state-metrics-tls" not found Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpmvq\" (UniqueName: \"kubernetes.io/projected/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-kube-api-access-tpmvq\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850254 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-sys\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850340 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-wtmp\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-textfile\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.850702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-sys\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.850702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850649 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-wtmp\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.851002 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850704 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-accelerators-collector-config\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.851002 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850750 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-metrics-client-ca\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.851002 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.850810 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-root\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.851316 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.851047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-textfile\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.851593 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.851548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14c961e8-3123-436b-bb52-ffa0ec350b34-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.853186 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.853156 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.853406 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.853390 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-tls\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.853506 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.853481 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.860389 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.860347 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqtz\" (UniqueName: \"kubernetes.io/projected/14c961e8-3123-436b-bb52-ffa0ec350b34-kube-api-access-2xqtz\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:11.860481 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.860397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpmvq\" (UniqueName: \"kubernetes.io/projected/58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a-kube-api-access-tpmvq\") pod \"node-exporter-5qwff\" (UID: \"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a\") " pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.933159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:11.933128 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5qwff" Jun 03 23:29:11.975860 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:11.975825 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f8f8dd_c0f3_4275_9d1a_8608c5aa5a6a.slice/crio-1f826687e23737e5db6da840d1ac23b768b1435c3119bc4c0ba543b4d15d8684 WatchSource:0}: Error finding container 1f826687e23737e5db6da840d1ac23b768b1435c3119bc4c0ba543b4d15d8684: Status 404 returned error can't find the container with id 1f826687e23737e5db6da840d1ac23b768b1435c3119bc4c0ba543b4d15d8684 Jun 03 23:29:12.353866 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.353824 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:12.356270 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.356246 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14c961e8-3123-436b-bb52-ffa0ec350b34-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-kdlb4\" (UID: \"14c961e8-3123-436b-bb52-ffa0ec350b34\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:12.465640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.465599 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5qwff" event={"ID":"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a","Type":"ContainerStarted","Data":"1f826687e23737e5db6da840d1ac23b768b1435c3119bc4c0ba543b4d15d8684"} Jun 03 23:29:12.522792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.522731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" Jun 03 23:29:12.673120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.673093 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:29:12.713653 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.713626 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:29:12.713753 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.713695 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4"] Jun 03 23:29:12.713825 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.713748 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.716971 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717229 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717372 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717428 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717650 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717827 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717876 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hqgh9\"" Jun 03 23:29:12.718095 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.717981 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 23:29:12.719090 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.718416 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 23:29:12.719090 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.718460 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 23:29:12.858156 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.857955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-web-config\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858156 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858027 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858156 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858060 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858156 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8mxb\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-kube-api-access-j8mxb\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858156 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858161 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-out\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858299 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858355 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.858528 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.858386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.958961 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.958919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-out\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.958978 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959036 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959065 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-web-config\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8mxb\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-kube-api-access-j8mxb\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.959451 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.959367 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.960910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.960175 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.960910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.960476 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.960910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.960821 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.963776 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.963727 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.965548 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.965439 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.965548 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.965506 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.966163 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.966035 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.966163 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.966061 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-out\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.966298 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.966192 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.966888 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.966823 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.966973 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.966943 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-web-config\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.967818 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.967789 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-volume\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:12.972501 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:12.972480 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8mxb\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-kube-api-access-j8mxb\") pod \"alertmanager-main-0\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:13.029697 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:13.029661 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:29:13.316100 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:13.316074 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:29:13.318211 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:13.318184 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb691d3_f5a7_41f4_b536_7aa3756ec967.slice/crio-210a5ef2562cda336d69bd3b177b3514335d2badd78147b42b9c8cbf3958b8f2 WatchSource:0}: Error finding container 210a5ef2562cda336d69bd3b177b3514335d2badd78147b42b9c8cbf3958b8f2: Status 404 returned error can't find the container with id 210a5ef2562cda336d69bd3b177b3514335d2badd78147b42b9c8cbf3958b8f2 Jun 03 23:29:13.473777 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:13.473742 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" event={"ID":"14c961e8-3123-436b-bb52-ffa0ec350b34","Type":"ContainerStarted","Data":"2dbc1d022f8760346a75870cb1086249396c10859c0927e9595867ef317a9e82"} Jun 03 23:29:13.473948 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:13.473812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" event={"ID":"14c961e8-3123-436b-bb52-ffa0ec350b34","Type":"ContainerStarted","Data":"64a40e565d3438957d7f900e0dd5ec3e7f4b49c92452b6c5b42029cff60d6e40"} Jun 03 23:29:13.473948 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:13.473841 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" event={"ID":"14c961e8-3123-436b-bb52-ffa0ec350b34","Type":"ContainerStarted","Data":"c199dbe06f9251b9ff0361e45198a67e00f8e7dad881532b42daad56b9766c41"} Jun 03 23:29:13.475098 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:13.475072 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"210a5ef2562cda336d69bd3b177b3514335d2badd78147b42b9c8cbf3958b8f2"} Jun 03 23:29:14.415475 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.415172 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:14.415475 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.415243 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:14.417124 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.417098 2566 patch_prober.go:28] interesting pod/console-787bc45b48-697rx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 03 23:29:14.417258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.417146 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-787bc45b48-697rx" podUID="aceded00-1da4-42ca-80fe-688b28e3d679" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 03 23:29:14.481165 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.481132 2566 generic.go:356] "Generic (PLEG): container finished" podID="58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a" containerID="95add9392ca9a3fd32353c6317b99e40f4173c1d2dbf19c42815b15ea0692fea" exitCode=0 Jun 03 23:29:14.481359 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.481211 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5qwff" event={"ID":"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a","Type":"ContainerDied","Data":"95add9392ca9a3fd32353c6317b99e40f4173c1d2dbf19c42815b15ea0692fea"} Jun 03 23:29:14.587523 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.587476 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45"] Jun 03 23:29:14.598435 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.598406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.601885 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.601859 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 03 23:29:14.602188 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.602162 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vjzm2\"" Jun 03 23:29:14.602390 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.602368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 03 23:29:14.602657 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.602434 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 03 23:29:14.602657 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.602551 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 03 23:29:14.602657 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.602579 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-74rmmfvinutdg\"" Jun 03 23:29:14.603146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.603124 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 03 23:29:14.605541 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.605520 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45"] Jun 03 23:29:14.674723 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlnts\" (UniqueName: \"kubernetes.io/projected/97bd76fd-c5da-4423-9530-c7baadcd664f-kube-api-access-tlnts\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.674723 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.674922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674729 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.674922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674783 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.674922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-tls\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.674922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674838 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-grpc-tls\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.674922 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674871 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97bd76fd-c5da-4423-9530-c7baadcd664f-metrics-client-ca\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.675170 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.674930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.775967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.775928 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.775967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.775971 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-tls\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.776207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.775989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-grpc-tls\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.776207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.776015 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97bd76fd-c5da-4423-9530-c7baadcd664f-metrics-client-ca\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.776207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.776079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.776207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.776124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlnts\" (UniqueName: \"kubernetes.io/projected/97bd76fd-c5da-4423-9530-c7baadcd664f-kube-api-access-tlnts\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.776448 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.776238 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.776448 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.776286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.777720 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.777666 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97bd76fd-c5da-4423-9530-c7baadcd664f-metrics-client-ca\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.779614 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.779556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-grpc-tls\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.780021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.779972 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.780353 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.780302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.780722 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.780699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-tls\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.780838 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.780702 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.781188 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.781153 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97bd76fd-c5da-4423-9530-c7baadcd664f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.786967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.786943 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlnts\" (UniqueName: \"kubernetes.io/projected/97bd76fd-c5da-4423-9530-c7baadcd664f-kube-api-access-tlnts\") pod \"thanos-querier-6c5d6b5c5d-l5h45\" (UID: \"97bd76fd-c5da-4423-9530-c7baadcd664f\") " pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:14.913146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:14.913112 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:15.146032 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.146004 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45"] Jun 03 23:29:15.155791 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:15.155763 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bd76fd_c5da_4423_9530_c7baadcd664f.slice/crio-e0c3515ced58946c615aaa2396eacfc5cb4b6f9161a1e22579e3a6a04057fd49 WatchSource:0}: Error finding container e0c3515ced58946c615aaa2396eacfc5cb4b6f9161a1e22579e3a6a04057fd49: Status 404 returned error can't find the container with id e0c3515ced58946c615aaa2396eacfc5cb4b6f9161a1e22579e3a6a04057fd49 Jun 03 23:29:15.487862 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.487780 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d" exitCode=0 Jun 03 23:29:15.488280 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.487869 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d"} Jun 03 23:29:15.489563 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.489540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"e0c3515ced58946c615aaa2396eacfc5cb4b6f9161a1e22579e3a6a04057fd49"} Jun 03 23:29:15.492104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.492066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5qwff" event={"ID":"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a","Type":"ContainerStarted","Data":"9e6257de915635789758c00d6a90e749abcad21ae581aad6f9d4a490923409ee"} Jun 03 23:29:15.492206 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.492115 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5qwff" event={"ID":"58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a","Type":"ContainerStarted","Data":"cef0cc43211f72352e12e7f32a87712caac6088c7c426bf7f15b93cfb55945e8"} Jun 03 23:29:15.494310 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.494269 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" event={"ID":"14c961e8-3123-436b-bb52-ffa0ec350b34","Type":"ContainerStarted","Data":"b442329e76e950918699431039a156ce1d17210a6581667a91dec40adfae214f"} Jun 03 23:29:15.535560 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.535514 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-kdlb4" podStartSLOduration=2.847620739 podStartE2EDuration="4.535502982s" totalImagesPullingTime="1.687882243s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:15.534490411 +0000 UTC m=+273.343997618" watchObservedRunningTime="2026-06-03 23:29:15.535502982 +0000 UTC m=+273.345010162" Jun 03 23:29:15.556770 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:15.556720 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5qwff" podStartSLOduration=2.881702669 podStartE2EDuration="4.556702691s" totalImagesPullingTime="1.548435245s" totalInitContainerRuntime="126.564777ms" isStatefulPod=true podCreationTimestamp="2026-06-03 23:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:15.556072703 +0000 UTC m=+273.365579886" watchObservedRunningTime="2026-06-03 23:29:15.556702691 +0000 UTC m=+273.366209873" Jun 03 23:29:21.109117 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.109078 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787bc45b48-697rx"] Jun 03 23:29:21.155555 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.155524 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f847fbb46-m6fgl"] Jun 03 23:29:21.158350 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.158306 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.168898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.168870 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 03 23:29:21.171062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.171040 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f847fbb46-m6fgl"] Jun 03 23:29:21.239237 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239175 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8ls\" (UniqueName: \"kubernetes.io/projected/1f437d18-487e-45a9-80db-ce7adab1eada-kube-api-access-vs8ls\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.239237 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-console-config\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.239500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-trusted-ca-bundle\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.239500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-service-ca\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.239500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239416 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-serving-cert\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.239500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239444 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-oauth-config\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.239500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.239476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-oauth-serving-cert\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340290 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-trusted-ca-bundle\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340304 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-service-ca\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340411 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-serving-cert\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-oauth-config\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-oauth-serving-cert\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340695 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8ls\" (UniqueName: \"kubernetes.io/projected/1f437d18-487e-45a9-80db-ce7adab1eada-kube-api-access-vs8ls\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.340695 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.340559 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-console-config\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.341316 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.341090 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-service-ca\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.341512 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.341423 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-trusted-ca-bundle\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.341512 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.341453 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-oauth-serving-cert\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.341760 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.341738 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-console-config\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.343701 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.343668 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-oauth-config\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.343836 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.343814 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-serving-cert\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.349108 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.349087 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8ls\" (UniqueName: \"kubernetes.io/projected/1f437d18-487e-45a9-80db-ce7adab1eada-kube-api-access-vs8ls\") pod \"console-7f847fbb46-m6fgl\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:21.470046 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:21.470010 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:24.115832 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:29:24.115780 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-fhvhv" podUID="79de725f-e691-444b-9cff-68ba59239f31" Jun 03 23:29:24.538666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:24.538640 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhvhv" Jun 03 23:29:24.818461 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:24.818302 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f847fbb46-m6fgl"] Jun 03 23:29:24.822137 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:24.822109 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f437d18_487e_45a9_80db_ce7adab1eada.slice/crio-f382ff1dcfc43cfc4af84669c49e00334beba1be9e4143f62b4c027d92876487 WatchSource:0}: Error finding container f382ff1dcfc43cfc4af84669c49e00334beba1be9e4143f62b4c027d92876487: Status 404 returned error can't find the container with id f382ff1dcfc43cfc4af84669c49e00334beba1be9e4143f62b4c027d92876487 Jun 03 23:29:25.550115 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.549954 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"a33738ad1ff1a276f2aa3f5841511a7bfa06adfa5a1404c015dda258634b1174"} Jun 03 23:29:25.550115 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.550039 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"1d75f925f464cc80304981570947041106d3ad912ecf4c3643552b4fe4b9d339"} Jun 03 23:29:25.550752 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.550727 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"492894ade8f3d38ca836b31f006820fb1e1c312480fa84b4919129f45eeb162a"} Jun 03 23:29:25.554870 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.554839 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f847fbb46-m6fgl" event={"ID":"1f437d18-487e-45a9-80db-ce7adab1eada","Type":"ContainerStarted","Data":"0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760"} Jun 03 23:29:25.554989 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.554885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f847fbb46-m6fgl" event={"ID":"1f437d18-487e-45a9-80db-ce7adab1eada","Type":"ContainerStarted","Data":"f382ff1dcfc43cfc4af84669c49e00334beba1be9e4143f62b4c027d92876487"} Jun 03 23:29:25.559554 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.559507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-56b467f5ff-4rh2l" event={"ID":"e70240a6-1818-46e1-b92e-d078d7f15997","Type":"ContainerStarted","Data":"15d0b9469cc08c16bd6e3e094311dfa37b0eacd199ba8986c0f9e134e300c279"} Jun 03 23:29:25.559861 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.559753 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:25.564484 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.564427 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e"} Jun 03 23:29:25.564484 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.564481 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453"} Jun 03 23:29:25.564646 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.564516 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751"} Jun 03 23:29:25.564646 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.564542 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da"} Jun 03 23:29:25.564646 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.564574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f"} Jun 03 23:29:25.576521 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.576470 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f847fbb46-m6fgl" podStartSLOduration=4.576456881 podStartE2EDuration="4.576456881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:25.574989522 +0000 UTC m=+283.384496715" watchObservedRunningTime="2026-06-03 23:29:25.576456881 +0000 UTC m=+283.385964046" Jun 03 23:29:25.581207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.581160 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-56b467f5ff-4rh2l" Jun 03 23:29:25.610632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:25.610459 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-56b467f5ff-4rh2l" podStartSLOduration=1.525040524 podStartE2EDuration="22.610437759s" totalImagesPullingTime="21.085397235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:25.608643251 +0000 UTC m=+283.418150433" watchObservedRunningTime="2026-06-03 23:29:25.610437759 +0000 UTC m=+283.419944943" Jun 03 23:29:26.579194 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.579158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"46c6b6439a7cbfe6a2c8364d5cb20c27be40d8fc0d2ca377ff80a6f52f96950a"} Jun 03 23:29:26.579682 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.579313 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"cd8f2e31017e4b0a975ca959c0d09621eb39c4289105bdabd9a8d959a064a1c6"} Jun 03 23:29:26.579682 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.579389 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" event={"ID":"97bd76fd-c5da-4423-9530-c7baadcd664f","Type":"ContainerStarted","Data":"858d3c4e1aec78158175a56fe40e000a39cc2e80f2d29a2324fc506e0c2c9ef4"} Jun 03 23:29:26.579682 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.579438 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:26.583717 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.583683 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerStarted","Data":"6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa"} Jun 03 23:29:26.607615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.607559 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" podStartSLOduration=2.35081176 podStartE2EDuration="12.60753818s" totalImagesPullingTime="10.25672642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:26.604918624 +0000 UTC m=+284.414425808" watchObservedRunningTime="2026-06-03 23:29:26.60753818 +0000 UTC m=+284.417045357" Jun 03 23:29:26.637560 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:26.637499 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.141146836 podStartE2EDuration="14.637475775s" totalImagesPullingTime="11.473559246s" totalInitContainerRuntime="22.769693ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:29:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:26.635828147 +0000 UTC m=+284.445335331" watchObservedRunningTime="2026-06-03 23:29:26.637475775 +0000 UTC m=+284.446982958" Jun 03 23:29:28.005458 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:28.005419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:29:28.011490 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:28.011451 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/79de725f-e691-444b-9cff-68ba59239f31-metrics-tls\") pod \"dns-default-fhvhv\" (UID: \"79de725f-e691-444b-9cff-68ba59239f31\") " pod="openshift-dns/dns-default-fhvhv" Jun 03 23:29:28.141893 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:28.141863 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-tjp8n\"" Jun 03 23:29:28.149487 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:28.149460 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fhvhv" Jun 03 23:29:28.351115 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:28.351033 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fhvhv"] Jun 03 23:29:28.353211 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:29:28.353184 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79de725f_e691_444b_9cff_68ba59239f31.slice/crio-f4c7410e47603e793134a12a16cf88ace9fca4fe4dc18a6066e1c98d2584b8ac WatchSource:0}: Error finding container f4c7410e47603e793134a12a16cf88ace9fca4fe4dc18a6066e1c98d2584b8ac: Status 404 returned error can't find the container with id f4c7410e47603e793134a12a16cf88ace9fca4fe4dc18a6066e1c98d2584b8ac Jun 03 23:29:28.595509 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:28.595415 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhvhv" event={"ID":"79de725f-e691-444b-9cff-68ba59239f31","Type":"ContainerStarted","Data":"f4c7410e47603e793134a12a16cf88ace9fca4fe4dc18a6066e1c98d2584b8ac"} Jun 03 23:29:31.471241 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.471205 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:31.471716 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.471280 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:31.476818 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.476792 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:31.617411 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.617369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhvhv" event={"ID":"79de725f-e691-444b-9cff-68ba59239f31","Type":"ContainerStarted","Data":"001e3cf018cf4ae8f9def5cff80bbd8e7221dc1ed0b509f30406bffba32cd23a"} Jun 03 23:29:31.617593 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.617465 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fhvhv" event={"ID":"79de725f-e691-444b-9cff-68ba59239f31","Type":"ContainerStarted","Data":"905bec40415f771a8b71d275c1a8acf8755a65329875494598a5fff2508adcbe"} Jun 03 23:29:31.617771 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.617740 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fhvhv" Jun 03 23:29:31.621924 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.621903 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:29:31.636372 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:31.636313 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fhvhv" podStartSLOduration=251.405348329 podStartE2EDuration="4m13.636299594s" totalImagesPullingTime="2.230951265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:29:31.634723308 +0000 UTC m=+289.444230488" watchObservedRunningTime="2026-06-03 23:29:31.636299594 +0000 UTC m=+289.445806775" Jun 03 23:29:32.597285 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:32.597251 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c5d6b5c5d-l5h45" Jun 03 23:29:41.625295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:41.625216 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fhvhv" Jun 03 23:29:41.660568 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:41.660541 2566 generic.go:356] "Generic (PLEG): container finished" podID="d6008800-6718-4bcc-972d-722eff0cbdd4" containerID="bcf428ea63efe73e1483920d844c896daf5279c7bb4988dbc866a1535a9060fb" exitCode=0 Jun 03 23:29:41.660710 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:41.660582 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" event={"ID":"d6008800-6718-4bcc-972d-722eff0cbdd4","Type":"ContainerDied","Data":"bcf428ea63efe73e1483920d844c896daf5279c7bb4988dbc866a1535a9060fb"} Jun 03 23:29:41.660898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:41.660881 2566 scope.go:117] "RemoveContainer" containerID="bcf428ea63efe73e1483920d844c896daf5279c7bb4988dbc866a1535a9060fb" Jun 03 23:29:42.609133 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:42.609100 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:29:42.612447 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:42.612423 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:29:42.617787 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:42.617768 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:29:42.618696 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:42.618679 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:29:42.623416 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:42.623402 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 03 23:29:42.665720 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:42.665609 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bc4cf794b-jpw7h" event={"ID":"d6008800-6718-4bcc-972d-722eff0cbdd4","Type":"ContainerStarted","Data":"7e6a732a6d17c5b9cd5d8e2c78381c024a1a15b859db04ef4f31663b2a7186ec"} Jun 03 23:29:46.132865 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.132799 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-787bc45b48-697rx" podUID="aceded00-1da4-42ca-80fe-688b28e3d679" containerName="console" containerID="cri-o://885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647" gracePeriod=15 Jun 03 23:29:46.422781 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.422756 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:46.565532 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.565502 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-oauth-config\") pod \"aceded00-1da4-42ca-80fe-688b28e3d679\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " Jun 03 23:29:46.565703 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.565553 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-oauth-serving-cert\") pod \"aceded00-1da4-42ca-80fe-688b28e3d679\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " Jun 03 23:29:46.565703 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.565601 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8ncr\" (UniqueName: \"kubernetes.io/projected/aceded00-1da4-42ca-80fe-688b28e3d679-kube-api-access-d8ncr\") pod \"aceded00-1da4-42ca-80fe-688b28e3d679\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " Jun 03 23:29:46.565703 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.565628 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-console-config\") pod \"aceded00-1da4-42ca-80fe-688b28e3d679\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " Jun 03 23:29:46.565703 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.565692 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-serving-cert\") pod \"aceded00-1da4-42ca-80fe-688b28e3d679\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " Jun 03 23:29:46.565910 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.565720 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-service-ca\") pod \"aceded00-1da4-42ca-80fe-688b28e3d679\" (UID: \"aceded00-1da4-42ca-80fe-688b28e3d679\") " Jun 03 23:29:46.566094 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.566051 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aceded00-1da4-42ca-80fe-688b28e3d679" (UID: "aceded00-1da4-42ca-80fe-688b28e3d679"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:46.566220 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.566066 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-console-config" (OuterVolumeSpecName: "console-config") pod "aceded00-1da4-42ca-80fe-688b28e3d679" (UID: "aceded00-1da4-42ca-80fe-688b28e3d679"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:46.566220 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.566117 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-service-ca" (OuterVolumeSpecName: "service-ca") pod "aceded00-1da4-42ca-80fe-688b28e3d679" (UID: "aceded00-1da4-42ca-80fe-688b28e3d679"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:29:46.567944 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.567916 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aceded00-1da4-42ca-80fe-688b28e3d679" (UID: "aceded00-1da4-42ca-80fe-688b28e3d679"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:29:46.568031 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.567942 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aceded00-1da4-42ca-80fe-688b28e3d679" (UID: "aceded00-1da4-42ca-80fe-688b28e3d679"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:29:46.568031 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.567951 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aceded00-1da4-42ca-80fe-688b28e3d679-kube-api-access-d8ncr" (OuterVolumeSpecName: "kube-api-access-d8ncr") pod "aceded00-1da4-42ca-80fe-688b28e3d679" (UID: "aceded00-1da4-42ca-80fe-688b28e3d679"). InnerVolumeSpecName "kube-api-access-d8ncr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:29:46.666666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.666598 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-oauth-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:29:46.666666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.666626 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-oauth-serving-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:29:46.666666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.666635 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8ncr\" (UniqueName: \"kubernetes.io/projected/aceded00-1da4-42ca-80fe-688b28e3d679-kube-api-access-d8ncr\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:29:46.666666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.666645 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-console-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:29:46.666666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.666654 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aceded00-1da4-42ca-80fe-688b28e3d679-console-serving-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:29:46.666666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.666663 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aceded00-1da4-42ca-80fe-688b28e3d679-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:29:46.682255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.682229 2566 generic.go:356] "Generic (PLEG): container finished" podID="aceded00-1da4-42ca-80fe-688b28e3d679" containerID="885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647" exitCode=0 Jun 03 23:29:46.682371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.682267 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-787bc45b48-697rx" Jun 03 23:29:46.682371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.682269 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787bc45b48-697rx" event={"ID":"aceded00-1da4-42ca-80fe-688b28e3d679","Type":"ContainerDied","Data":"885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647"} Jun 03 23:29:46.682371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.682314 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-787bc45b48-697rx" event={"ID":"aceded00-1da4-42ca-80fe-688b28e3d679","Type":"ContainerDied","Data":"822dc545f21b940ec452661678a2e9684ce5a2da9069af7430c4ecf15101c248"} Jun 03 23:29:46.682371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.682355 2566 scope.go:117] "RemoveContainer" containerID="885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647" Jun 03 23:29:46.690511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.690495 2566 scope.go:117] "RemoveContainer" containerID="885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647" Jun 03 23:29:46.690771 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:29:46.690742 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647\": container with ID starting with 885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647 not found: ID does not exist" containerID="885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647" Jun 03 23:29:46.690819 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.690781 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647"} err="failed to get container status \"885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647\": rpc error: code = NotFound desc = could not find container \"885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647\": container with ID starting with 885971e119b360ed97c9e16f29c3517d48e68c9be2270e7666c161a5f04da647 not found: ID does not exist" Jun 03 23:29:46.703434 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.703402 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-787bc45b48-697rx"] Jun 03 23:29:46.704740 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:46.704721 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-787bc45b48-697rx"] Jun 03 23:29:48.660832 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:48.660798 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aceded00-1da4-42ca-80fe-688b28e3d679" path="/var/lib/kubelet/pods/aceded00-1da4-42ca-80fe-688b28e3d679/volumes" Jun 03 23:29:57.369133 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:29:57.369106 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mt7pc_ec75febd-1f67-4db2-82bc-4a2a4152d84a/serve-healthcheck-canary/0.log" Jun 03 23:30:28.350097 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.350060 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c7549fbfb-wfmb9"] Jun 03 23:30:28.350561 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.350473 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aceded00-1da4-42ca-80fe-688b28e3d679" containerName="console" Jun 03 23:30:28.350561 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.350487 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="aceded00-1da4-42ca-80fe-688b28e3d679" containerName="console" Jun 03 23:30:28.350634 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.350573 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="aceded00-1da4-42ca-80fe-688b28e3d679" containerName="console" Jun 03 23:30:28.353049 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.353024 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.365891 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.365866 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7549fbfb-wfmb9"] Jun 03 23:30:28.398479 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398442 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fllsr\" (UniqueName: \"kubernetes.io/projected/8d66bc1b-1725-4327-830e-da9ad6b85146-kube-api-access-fllsr\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.398650 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398500 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-service-ca\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.398650 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-oauth-serving-cert\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.398650 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-serving-cert\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.398650 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398567 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-oauth-config\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.398650 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-console-config\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.398650 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.398651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-trusted-ca-bundle\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499410 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499370 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fllsr\" (UniqueName: \"kubernetes.io/projected/8d66bc1b-1725-4327-830e-da9ad6b85146-kube-api-access-fllsr\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499410 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-service-ca\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499431 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-oauth-serving-cert\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-serving-cert\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-oauth-config\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499791 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-console-config\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.499791 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.499689 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-trusted-ca-bundle\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.500250 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.500217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-oauth-serving-cert\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.500560 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.500217 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-service-ca\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.500560 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.500391 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-console-config\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.500560 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.500526 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-trusted-ca-bundle\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.502203 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.502171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-oauth-config\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.502378 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.502356 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-serving-cert\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.507624 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.507605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fllsr\" (UniqueName: \"kubernetes.io/projected/8d66bc1b-1725-4327-830e-da9ad6b85146-kube-api-access-fllsr\") pod \"console-6c7549fbfb-wfmb9\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.666398 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.666297 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:28.794787 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.794762 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c7549fbfb-wfmb9"] Jun 03 23:30:28.797006 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:30:28.796982 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d66bc1b_1725_4327_830e_da9ad6b85146.slice/crio-c3dc94835b0bce31d341936be9d04670e58d16f2330fc4af1cc47d637f88b28b WatchSource:0}: Error finding container c3dc94835b0bce31d341936be9d04670e58d16f2330fc4af1cc47d637f88b28b: Status 404 returned error can't find the container with id c3dc94835b0bce31d341936be9d04670e58d16f2330fc4af1cc47d637f88b28b Jun 03 23:30:28.861363 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.861314 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7549fbfb-wfmb9" event={"ID":"8d66bc1b-1725-4327-830e-da9ad6b85146","Type":"ContainerStarted","Data":"1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452"} Jun 03 23:30:28.861469 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.861381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7549fbfb-wfmb9" event={"ID":"8d66bc1b-1725-4327-830e-da9ad6b85146","Type":"ContainerStarted","Data":"c3dc94835b0bce31d341936be9d04670e58d16f2330fc4af1cc47d637f88b28b"} Jun 03 23:30:28.889663 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:28.889606 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c7549fbfb-wfmb9" podStartSLOduration=0.889584417 podStartE2EDuration="889.584417ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:28.887844467 +0000 UTC m=+346.697351649" watchObservedRunningTime="2026-06-03 23:30:28.889584417 +0000 UTC m=+346.699091600" Jun 03 23:30:31.953028 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.952997 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:30:31.953513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.953381 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-metric" containerID="cri-o://08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e" gracePeriod=120 Jun 03 23:30:31.953513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.953413 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-web" containerID="cri-o://d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751" gracePeriod=120 Jun 03 23:30:31.953513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.953445 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="config-reloader" containerID="cri-o://5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da" gracePeriod=120 Jun 03 23:30:31.953513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.953459 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy" containerID="cri-o://d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453" gracePeriod=120 Jun 03 23:30:31.953513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.953354 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="alertmanager" containerID="cri-o://fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f" gracePeriod=120 Jun 03 23:30:31.953848 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:31.953440 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="prom-label-proxy" containerID="cri-o://6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa" gracePeriod=120 Jun 03 23:30:32.879445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879412 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa" exitCode=0 Jun 03 23:30:32.879445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879442 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e" exitCode=0 Jun 03 23:30:32.879445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879450 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453" exitCode=0 Jun 03 23:30:32.879445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879458 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da" exitCode=0 Jun 03 23:30:32.879445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879466 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f" exitCode=0 Jun 03 23:30:32.879756 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879490 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa"} Jun 03 23:30:32.879756 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879554 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e"} Jun 03 23:30:32.879756 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453"} Jun 03 23:30:32.879756 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da"} Jun 03 23:30:32.879756 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:32.879626 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f"} Jun 03 23:30:33.200939 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.200915 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:33.340092 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340058 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-main-tls\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340268 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340114 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340268 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340155 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-tls-assets\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340268 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340189 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-trusted-ca-bundle\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340275 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-volume\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340309 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-web-config\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340372 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-metrics-client-ca\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340413 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8mxb\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-kube-api-access-j8mxb\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340441 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-metric\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340477 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-web\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340514 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-out\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340578 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-main-db\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340609 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-cluster-tls-config\") pod \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\" (UID: \"dbb691d3-f5a7-41f4-b536-7aa3756ec967\") " Jun 03 23:30:33.340785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340632 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:33.341154 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.340861 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.341825 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.341631 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:30:33.341825 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.341751 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:30:33.344019 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.343983 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.344271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.344198 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.344271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.344217 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.344271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.344228 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-out" (OuterVolumeSpecName: "config-out") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:30:33.344271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.344236 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.344487 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.344272 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:30:33.344685 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.344662 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-volume" (OuterVolumeSpecName: "config-volume") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.345846 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.345824 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-kube-api-access-j8mxb" (OuterVolumeSpecName: "kube-api-access-j8mxb") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "kube-api-access-j8mxb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:30:33.349149 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.349124 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.355037 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.355014 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-web-config" (OuterVolumeSpecName: "web-config") pod "dbb691d3-f5a7-41f4-b536-7aa3756ec967" (UID: "dbb691d3-f5a7-41f4-b536-7aa3756ec967"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:30:33.441564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441506 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-volume\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441525 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-web-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441533 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb691d3-f5a7-41f4-b536-7aa3756ec967-metrics-client-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441542 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8mxb\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-kube-api-access-j8mxb\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441551 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441564 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441560 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441569 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-config-out\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441578 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dbb691d3-f5a7-41f4-b536-7aa3756ec967-alertmanager-main-db\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441585 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-cluster-tls-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441593 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-main-tls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441601 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbb691d3-f5a7-41f4-b536-7aa3756ec967-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.441793 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.441610 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dbb691d3-f5a7-41f4-b536-7aa3756ec967-tls-assets\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:30:33.886784 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.886750 2566 generic.go:356] "Generic (PLEG): container finished" podID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerID="d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751" exitCode=0 Jun 03 23:30:33.886972 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.886810 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751"} Jun 03 23:30:33.886972 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.886834 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:33.886972 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.886869 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dbb691d3-f5a7-41f4-b536-7aa3756ec967","Type":"ContainerDied","Data":"210a5ef2562cda336d69bd3b177b3514335d2badd78147b42b9c8cbf3958b8f2"} Jun 03 23:30:33.886972 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.886903 2566 scope.go:117] "RemoveContainer" containerID="6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa" Jun 03 23:30:33.895360 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.895343 2566 scope.go:117] "RemoveContainer" containerID="08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e" Jun 03 23:30:33.902340 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.902304 2566 scope.go:117] "RemoveContainer" containerID="d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453" Jun 03 23:30:33.911504 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.911485 2566 scope.go:117] "RemoveContainer" containerID="d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751" Jun 03 23:30:33.913828 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.913807 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:30:33.915441 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.915417 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:30:33.919403 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.919387 2566 scope.go:117] "RemoveContainer" containerID="5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da" Jun 03 23:30:33.926226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.926206 2566 scope.go:117] "RemoveContainer" containerID="fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f" Jun 03 23:30:33.933213 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.933197 2566 scope.go:117] "RemoveContainer" containerID="ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d" Jun 03 23:30:33.940365 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.940347 2566 scope.go:117] "RemoveContainer" containerID="6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa" Jun 03 23:30:33.940639 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.940619 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa\": container with ID starting with 6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa not found: ID does not exist" containerID="6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa" Jun 03 23:30:33.940728 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.940645 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa"} err="failed to get container status \"6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa\": rpc error: code = NotFound desc = could not find container \"6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa\": container with ID starting with 6ab829f0ffbe026b8d81877f5f2ede9cc33c8075c1b72e96c7d49b4a3e34cbfa not found: ID does not exist" Jun 03 23:30:33.940728 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.940664 2566 scope.go:117] "RemoveContainer" containerID="08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e" Jun 03 23:30:33.940943 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.940928 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e\": container with ID starting with 08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e not found: ID does not exist" containerID="08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e" Jun 03 23:30:33.940999 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.940947 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e"} err="failed to get container status \"08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e\": rpc error: code = NotFound desc = could not find container \"08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e\": container with ID starting with 08b828029267936021b4037e1ced87c1a94b522f361c89e925a5db83d5230d0e not found: ID does not exist" Jun 03 23:30:33.940999 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.940960 2566 scope.go:117] "RemoveContainer" containerID="d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453" Jun 03 23:30:33.941142 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941122 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:30:33.941206 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.941185 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453\": container with ID starting with d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453 not found: ID does not exist" containerID="d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453" Jun 03 23:30:33.941238 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941215 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453"} err="failed to get container status \"d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453\": rpc error: code = NotFound desc = could not find container \"d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453\": container with ID starting with d5e8084c4c473870132f352c88a721761919c52ecbc5cf1c43dbbf3e1400c453 not found: ID does not exist" Jun 03 23:30:33.941274 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941236 2566 scope.go:117] "RemoveContainer" containerID="d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751" Jun 03 23:30:33.941517 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941502 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="alertmanager" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941523 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="alertmanager" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941531 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941536 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941549 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="config-reloader" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941555 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="config-reloader" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941561 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-metric" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941566 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-metric" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941572 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="init-config-reloader" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941578 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="init-config-reloader" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.941502 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751\": container with ID starting with d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751 not found: ID does not exist" containerID="d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941606 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751"} err="failed to get container status \"d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751\": rpc error: code = NotFound desc = could not find container \"d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751\": container with ID starting with d479afdfddb08912723019bae13bd2fcd2e70086beb68bf18b55f27a945a7751 not found: ID does not exist" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941622 2566 scope.go:117] "RemoveContainer" containerID="5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da" Jun 03 23:30:33.941647 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941584 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="prom-label-proxy" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941660 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="prom-label-proxy" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941673 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-web" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941679 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-web" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941760 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="config-reloader" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941778 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="alertmanager" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941788 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-metric" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941799 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="prom-label-proxy" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941816 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy-web" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941826 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" containerName="kube-rbac-proxy" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.941889 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da\": container with ID starting with 5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da not found: ID does not exist" containerID="5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941922 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da"} err="failed to get container status \"5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da\": rpc error: code = NotFound desc = could not find container \"5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da\": container with ID starting with 5bad8bff2bcb6406b89d12d6d3dbee72793d2dde6fd042b93de109f1722189da not found: ID does not exist" Jun 03 23:30:33.942083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.941935 2566 scope.go:117] "RemoveContainer" containerID="fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f" Jun 03 23:30:33.942597 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.942197 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f\": container with ID starting with fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f not found: ID does not exist" containerID="fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f" Jun 03 23:30:33.942597 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.942219 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f"} err="failed to get container status \"fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f\": rpc error: code = NotFound desc = could not find container \"fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f\": container with ID starting with fd5b5823e1f7253aab3a9cc74c7d7120cc125dda8c9a63f35c41b7af6b8c526f not found: ID does not exist" Jun 03 23:30:33.942597 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.942232 2566 scope.go:117] "RemoveContainer" containerID="ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d" Jun 03 23:30:33.942597 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:30:33.942460 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d\": container with ID starting with ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d not found: ID does not exist" containerID="ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d" Jun 03 23:30:33.942597 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.942485 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d"} err="failed to get container status \"ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d\": rpc error: code = NotFound desc = could not find container \"ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d\": container with ID starting with ef1006c1bd029075497df364b7b40c0060415c8021285db309816b818af1479d not found: ID does not exist" Jun 03 23:30:33.945737 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.945720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:33.948632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.948601 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 03 23:30:33.948632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.948626 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 03 23:30:33.948778 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.948654 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-hqgh9\"" Jun 03 23:30:33.948778 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.948697 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 03 23:30:33.948994 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.948974 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 03 23:30:33.949092 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.949051 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 03 23:30:33.949092 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.949071 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 03 23:30:33.949234 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.949217 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 03 23:30:33.949407 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.949391 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 03 23:30:33.954368 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.954348 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 03 23:30:33.962581 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:33.962555 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:30:34.046174 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-config-volume\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046250 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046250 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046205 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-web-config\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046340 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/424607e8-7941-4b6d-ae6d-8a70f588448d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046372 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046339 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046407 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046385 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/424607e8-7941-4b6d-ae6d-8a70f588448d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046440 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/424607e8-7941-4b6d-ae6d-8a70f588448d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046484 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/424607e8-7941-4b6d-ae6d-8a70f588448d-config-out\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046515 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046551 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046511 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424607e8-7941-4b6d-ae6d-8a70f588448d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046551 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt4xz\" (UniqueName: \"kubernetes.io/projected/424607e8-7941-4b6d-ae6d-8a70f588448d-kube-api-access-rt4xz\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.046615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.046593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147212 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/424607e8-7941-4b6d-ae6d-8a70f588448d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147212 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147174 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/424607e8-7941-4b6d-ae6d-8a70f588448d-config-out\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147212 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147478 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424607e8-7941-4b6d-ae6d-8a70f588448d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147478 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt4xz\" (UniqueName: \"kubernetes.io/projected/424607e8-7941-4b6d-ae6d-8a70f588448d-kube-api-access-rt4xz\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147478 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147389 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147478 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147675 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147489 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-config-volume\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147675 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147675 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-web-config\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147675 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/424607e8-7941-4b6d-ae6d-8a70f588448d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147675 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147631 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.147920 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.147690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/424607e8-7941-4b6d-ae6d-8a70f588448d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.148152 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.148006 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/424607e8-7941-4b6d-ae6d-8a70f588448d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.148152 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.148144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/424607e8-7941-4b6d-ae6d-8a70f588448d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.150139 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.150111 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/424607e8-7941-4b6d-ae6d-8a70f588448d-config-out\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.150637 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.150587 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151020 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.150887 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-web-config\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151020 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.150970 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/424607e8-7941-4b6d-ae6d-8a70f588448d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151157 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.151129 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151157 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.151142 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151157 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.151148 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/424607e8-7941-4b6d-ae6d-8a70f588448d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151297 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.151264 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.151790 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.151769 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.152570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.152551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/424607e8-7941-4b6d-ae6d-8a70f588448d-config-volume\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.157230 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.157209 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt4xz\" (UniqueName: \"kubernetes.io/projected/424607e8-7941-4b6d-ae6d-8a70f588448d-kube-api-access-rt4xz\") pod \"alertmanager-main-0\" (UID: \"424607e8-7941-4b6d-ae6d-8a70f588448d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.256899 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.256877 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 03 23:30:34.395554 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.395527 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 03 23:30:34.397969 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:30:34.397907 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424607e8_7941_4b6d_ae6d_8a70f588448d.slice/crio-a79b36ea2b4b9159e9b18fbefb14ddd8b91875c973064633f15314c967ba4629 WatchSource:0}: Error finding container a79b36ea2b4b9159e9b18fbefb14ddd8b91875c973064633f15314c967ba4629: Status 404 returned error can't find the container with id a79b36ea2b4b9159e9b18fbefb14ddd8b91875c973064633f15314c967ba4629 Jun 03 23:30:34.658852 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.658775 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbb691d3-f5a7-41f4-b536-7aa3756ec967" path="/var/lib/kubelet/pods/dbb691d3-f5a7-41f4-b536-7aa3756ec967/volumes" Jun 03 23:30:34.893558 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.893520 2566 generic.go:356] "Generic (PLEG): container finished" podID="424607e8-7941-4b6d-ae6d-8a70f588448d" containerID="2219f249d6b6fb567477742aafeefe6f2b84fd8629710fdb2eb30c55f973d165" exitCode=0 Jun 03 23:30:34.893725 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.893570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerDied","Data":"2219f249d6b6fb567477742aafeefe6f2b84fd8629710fdb2eb30c55f973d165"} Jun 03 23:30:34.893725 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:34.893625 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"a79b36ea2b4b9159e9b18fbefb14ddd8b91875c973064633f15314c967ba4629"} Jun 03 23:30:35.901395 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.901356 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"62cd340a298ab4d197b67789f122aa859f0d4f48dce7850d1c42a831842a3d10"} Jun 03 23:30:35.901796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.901426 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"cb3852e74275562f2a963768e152871b1cc9eb99dcbb0e71481fd108cec20546"} Jun 03 23:30:35.901796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.901455 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"7aa851ac154bbe2cf20c6cbe3e24200b194da51ae0fa29945411ce37fc17365c"} Jun 03 23:30:35.901796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.901483 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"8e8e04995949542a4ffe97770c519ceb753648462e4e794eeaf94a7d0d89cf00"} Jun 03 23:30:35.901796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.901509 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"2c3605508472a94684a7516965159ff51b2af6af0d29c9194002b1e723cde8b7"} Jun 03 23:30:35.901796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.901536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"424607e8-7941-4b6d-ae6d-8a70f588448d","Type":"ContainerStarted","Data":"fa02ecb4aa9763df139c4cf31ababa0fccb4f4c7509d91743f5f7f114684082c"} Jun 03 23:30:35.929213 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:35.929168 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.914059037 podStartE2EDuration="2.929153471s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.094434ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:30:35.926800194 +0000 UTC m=+353.736307374" watchObservedRunningTime="2026-06-03 23:30:35.929153471 +0000 UTC m=+353.738660653" Jun 03 23:30:38.667167 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:38.667137 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:38.667602 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:38.667402 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:38.671834 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:38.671812 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:38.917101 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:38.917074 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:30:38.971750 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:30:38.971717 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f847fbb46-m6fgl"] Jun 03 23:31:03.992644 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:03.992597 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f847fbb46-m6fgl" podUID="1f437d18-487e-45a9-80db-ce7adab1eada" containerName="console" containerID="cri-o://0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760" gracePeriod=15 Jun 03 23:31:04.247446 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.247392 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:31:04.285646 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285613 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-console-config\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.285646 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285646 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-service-ca\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.285845 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285673 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-trusted-ca-bundle\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.285845 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285728 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs8ls\" (UniqueName: \"kubernetes.io/projected/1f437d18-487e-45a9-80db-ce7adab1eada-kube-api-access-vs8ls\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.285845 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285751 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-oauth-config\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.285845 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285778 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-oauth-serving-cert\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.286035 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285930 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-serving-cert\") pod \"1f437d18-487e-45a9-80db-ce7adab1eada\" (UID: \"1f437d18-487e-45a9-80db-ce7adab1eada\") " Jun 03 23:31:04.286035 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.285988 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:31:04.286126 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.286093 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-console-config" (OuterVolumeSpecName: "console-config") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:31:04.286198 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.286179 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:31:04.286198 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.286180 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:31:04.286352 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.286208 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-console-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:04.286352 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.286230 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:04.287956 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.287933 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:31:04.288063 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.288048 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f437d18-487e-45a9-80db-ce7adab1eada-kube-api-access-vs8ls" (OuterVolumeSpecName: "kube-api-access-vs8ls") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "kube-api-access-vs8ls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:31:04.288377 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.288351 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f437d18-487e-45a9-80db-ce7adab1eada" (UID: "1f437d18-487e-45a9-80db-ce7adab1eada"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:31:04.387615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.387586 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-trusted-ca-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:04.387615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.387610 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs8ls\" (UniqueName: \"kubernetes.io/projected/1f437d18-487e-45a9-80db-ce7adab1eada-kube-api-access-vs8ls\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:04.387615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.387619 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-oauth-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:04.387818 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.387628 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f437d18-487e-45a9-80db-ce7adab1eada-oauth-serving-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:04.387818 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:04.387637 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f437d18-487e-45a9-80db-ce7adab1eada-console-serving-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:05.013999 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.013965 2566 generic.go:356] "Generic (PLEG): container finished" podID="1f437d18-487e-45a9-80db-ce7adab1eada" containerID="0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760" exitCode=0 Jun 03 23:31:05.014442 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.014007 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f847fbb46-m6fgl" Jun 03 23:31:05.014442 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.014053 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f847fbb46-m6fgl" event={"ID":"1f437d18-487e-45a9-80db-ce7adab1eada","Type":"ContainerDied","Data":"0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760"} Jun 03 23:31:05.014442 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.014100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f847fbb46-m6fgl" event={"ID":"1f437d18-487e-45a9-80db-ce7adab1eada","Type":"ContainerDied","Data":"f382ff1dcfc43cfc4af84669c49e00334beba1be9e4143f62b4c027d92876487"} Jun 03 23:31:05.014442 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.014121 2566 scope.go:117] "RemoveContainer" containerID="0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760" Jun 03 23:31:05.024479 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.024461 2566 scope.go:117] "RemoveContainer" containerID="0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760" Jun 03 23:31:05.024741 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:31:05.024725 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760\": container with ID starting with 0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760 not found: ID does not exist" containerID="0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760" Jun 03 23:31:05.024791 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.024748 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760"} err="failed to get container status \"0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760\": rpc error: code = NotFound desc = could not find container \"0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760\": container with ID starting with 0d9bd91d828661a3df41bf96288a002d645e705f6039bdb880336ded139e1760 not found: ID does not exist" Jun 03 23:31:05.033611 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.033590 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f847fbb46-m6fgl"] Jun 03 23:31:05.037042 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:05.037019 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f847fbb46-m6fgl"] Jun 03 23:31:06.659227 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:06.659183 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f437d18-487e-45a9-80db-ce7adab1eada" path="/var/lib/kubelet/pods/1f437d18-487e-45a9-80db-ce7adab1eada/volumes" Jun 03 23:31:36.438822 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.438788 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck"] Jun 03 23:31:36.439277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.439102 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f437d18-487e-45a9-80db-ce7adab1eada" containerName="console" Jun 03 23:31:36.439277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.439113 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f437d18-487e-45a9-80db-ce7adab1eada" containerName="console" Jun 03 23:31:36.439277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.439170 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f437d18-487e-45a9-80db-ce7adab1eada" containerName="console" Jun 03 23:31:36.441433 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.441416 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.444365 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.444338 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:31:36.444490 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.444417 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m48wl\"" Jun 03 23:31:36.445668 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.445649 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:31:36.451854 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.451834 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck"] Jun 03 23:31:36.529226 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.529202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drzwq\" (UniqueName: \"kubernetes.io/projected/4ff76793-f7e6-4106-8fca-56f868c49f7c-kube-api-access-drzwq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.529365 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.529251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.529365 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.529279 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.629901 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.629874 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drzwq\" (UniqueName: \"kubernetes.io/projected/4ff76793-f7e6-4106-8fca-56f868c49f7c-kube-api-access-drzwq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.630023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.629929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.630023 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.629962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.630297 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.630281 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.630380 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.630303 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.638599 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.638580 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drzwq\" (UniqueName: \"kubernetes.io/projected/4ff76793-f7e6-4106-8fca-56f868c49f7c-kube-api-access-drzwq\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.750609 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.750590 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:36.880154 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.880113 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck"] Jun 03 23:31:36.882968 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:31:36.882942 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff76793_f7e6_4106_8fca_56f868c49f7c.slice/crio-f042dfb84c927cd52b580ab89feff1ef6ed94a29948fc04283ca0a46ff2148df WatchSource:0}: Error finding container f042dfb84c927cd52b580ab89feff1ef6ed94a29948fc04283ca0a46ff2148df: Status 404 returned error can't find the container with id f042dfb84c927cd52b580ab89feff1ef6ed94a29948fc04283ca0a46ff2148df Jun 03 23:31:36.884917 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:36.884901 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:31:37.141767 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:37.141688 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" event={"ID":"4ff76793-f7e6-4106-8fca-56f868c49f7c","Type":"ContainerStarted","Data":"f042dfb84c927cd52b580ab89feff1ef6ed94a29948fc04283ca0a46ff2148df"} Jun 03 23:31:45.177449 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:45.177407 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerID="36b09275e568f8882f6da2688fa01edd54e136d3b91fd1a70eed4c53e24ff7b4" exitCode=0 Jun 03 23:31:45.177856 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:45.177456 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" event={"ID":"4ff76793-f7e6-4106-8fca-56f868c49f7c","Type":"ContainerDied","Data":"36b09275e568f8882f6da2688fa01edd54e136d3b91fd1a70eed4c53e24ff7b4"} Jun 03 23:31:47.188412 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:47.188381 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" event={"ID":"4ff76793-f7e6-4106-8fca-56f868c49f7c","Type":"ContainerStarted","Data":"d953a58270483817b10b6b4b8f14e290fbf835ab95c1627b661b27ff4d48dfab"} Jun 03 23:31:48.194445 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:48.194402 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerID="d953a58270483817b10b6b4b8f14e290fbf835ab95c1627b661b27ff4d48dfab" exitCode=0 Jun 03 23:31:48.194914 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:48.194496 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" event={"ID":"4ff76793-f7e6-4106-8fca-56f868c49f7c","Type":"ContainerDied","Data":"d953a58270483817b10b6b4b8f14e290fbf835ab95c1627b661b27ff4d48dfab"} Jun 03 23:31:57.235120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:57.235085 2566 generic.go:356] "Generic (PLEG): container finished" podID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerID="127522ebbeaa81c5f35c77b439aa64a2cc95f61276b87993b07ae6ec6e6b3d7c" exitCode=0 Jun 03 23:31:57.235494 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:57.235176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" event={"ID":"4ff76793-f7e6-4106-8fca-56f868c49f7c","Type":"ContainerDied","Data":"127522ebbeaa81c5f35c77b439aa64a2cc95f61276b87993b07ae6ec6e6b3d7c"} Jun 03 23:31:58.407887 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.407861 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:58.518218 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.518152 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drzwq\" (UniqueName: \"kubernetes.io/projected/4ff76793-f7e6-4106-8fca-56f868c49f7c-kube-api-access-drzwq\") pod \"4ff76793-f7e6-4106-8fca-56f868c49f7c\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " Jun 03 23:31:58.518218 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.518195 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-bundle\") pod \"4ff76793-f7e6-4106-8fca-56f868c49f7c\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " Jun 03 23:31:58.518458 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.518226 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-util\") pod \"4ff76793-f7e6-4106-8fca-56f868c49f7c\" (UID: \"4ff76793-f7e6-4106-8fca-56f868c49f7c\") " Jun 03 23:31:58.518779 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.518756 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-bundle" (OuterVolumeSpecName: "bundle") pod "4ff76793-f7e6-4106-8fca-56f868c49f7c" (UID: "4ff76793-f7e6-4106-8fca-56f868c49f7c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:31:58.520487 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.520464 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff76793-f7e6-4106-8fca-56f868c49f7c-kube-api-access-drzwq" (OuterVolumeSpecName: "kube-api-access-drzwq") pod "4ff76793-f7e6-4106-8fca-56f868c49f7c" (UID: "4ff76793-f7e6-4106-8fca-56f868c49f7c"). InnerVolumeSpecName "kube-api-access-drzwq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:31:58.522655 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.522629 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-util" (OuterVolumeSpecName: "util") pod "4ff76793-f7e6-4106-8fca-56f868c49f7c" (UID: "4ff76793-f7e6-4106-8fca-56f868c49f7c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:31:58.618844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.618817 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drzwq\" (UniqueName: \"kubernetes.io/projected/4ff76793-f7e6-4106-8fca-56f868c49f7c-kube-api-access-drzwq\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:58.618844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.618842 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:58.618844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:58.618851 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ff76793-f7e6-4106-8fca-56f868c49f7c-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:31:59.246627 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:59.246597 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" event={"ID":"4ff76793-f7e6-4106-8fca-56f868c49f7c","Type":"ContainerDied","Data":"f042dfb84c927cd52b580ab89feff1ef6ed94a29948fc04283ca0a46ff2148df"} Jun 03 23:31:59.246627 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:59.246632 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19d9thck" Jun 03 23:31:59.246888 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:31:59.246641 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f042dfb84c927cd52b580ab89feff1ef6ed94a29948fc04283ca0a46ff2148df" Jun 03 23:32:04.171089 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171053 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv"] Jun 03 23:32:04.171491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171413 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="util" Jun 03 23:32:04.171491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171430 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="util" Jun 03 23:32:04.171491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171444 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="pull" Jun 03 23:32:04.171491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171452 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="pull" Jun 03 23:32:04.171491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171473 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="extract" Jun 03 23:32:04.171491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171478 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="extract" Jun 03 23:32:04.171678 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.171530 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff76793-f7e6-4106-8fca-56f868c49f7c" containerName="extract" Jun 03 23:32:04.173565 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.173549 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.176803 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.176783 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:32:04.176924 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.176782 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-7ppgj\"" Jun 03 23:32:04.176924 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.176788 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 03 23:32:04.186791 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.186770 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv"] Jun 03 23:32:04.366260 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.366233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8m7d\" (UniqueName: \"kubernetes.io/projected/d6c91de6-7552-4724-bf8e-db5574751796-kube-api-access-d8m7d\") pod \"cert-manager-operator-controller-manager-57757f7cfc-499jv\" (UID: \"d6c91de6-7552-4724-bf8e-db5574751796\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.366447 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.366267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6c91de6-7552-4724-bf8e-db5574751796-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-499jv\" (UID: \"d6c91de6-7552-4724-bf8e-db5574751796\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.467643 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.467614 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8m7d\" (UniqueName: \"kubernetes.io/projected/d6c91de6-7552-4724-bf8e-db5574751796-kube-api-access-d8m7d\") pod \"cert-manager-operator-controller-manager-57757f7cfc-499jv\" (UID: \"d6c91de6-7552-4724-bf8e-db5574751796\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.467785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.467646 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6c91de6-7552-4724-bf8e-db5574751796-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-499jv\" (UID: \"d6c91de6-7552-4724-bf8e-db5574751796\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.468085 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.468067 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6c91de6-7552-4724-bf8e-db5574751796-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-499jv\" (UID: \"d6c91de6-7552-4724-bf8e-db5574751796\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.476562 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.476541 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8m7d\" (UniqueName: \"kubernetes.io/projected/d6c91de6-7552-4724-bf8e-db5574751796-kube-api-access-d8m7d\") pod \"cert-manager-operator-controller-manager-57757f7cfc-499jv\" (UID: \"d6c91de6-7552-4724-bf8e-db5574751796\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.482339 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.482300 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" Jun 03 23:32:04.617059 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:04.617033 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv"] Jun 03 23:32:04.619826 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:04.619803 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6c91de6_7552_4724_bf8e_db5574751796.slice/crio-b63345fe25bc6e6d40c75df8f2fc9c90b0300b6446a0a558c98bec4cce40e2f7 WatchSource:0}: Error finding container b63345fe25bc6e6d40c75df8f2fc9c90b0300b6446a0a558c98bec4cce40e2f7: Status 404 returned error can't find the container with id b63345fe25bc6e6d40c75df8f2fc9c90b0300b6446a0a558c98bec4cce40e2f7 Jun 03 23:32:05.271104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:05.271065 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" event={"ID":"d6c91de6-7552-4724-bf8e-db5574751796","Type":"ContainerStarted","Data":"b63345fe25bc6e6d40c75df8f2fc9c90b0300b6446a0a558c98bec4cce40e2f7"} Jun 03 23:32:07.282472 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:07.282133 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" event={"ID":"d6c91de6-7552-4724-bf8e-db5574751796","Type":"ContainerStarted","Data":"9fd7a3011c3b1dbc7c28bcb7c1d4aa7a949dc700a1c09de2ec6aff08016c5153"} Jun 03 23:32:07.305827 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:07.305773 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-499jv" podStartSLOduration=0.739403759 podStartE2EDuration="3.305758563s" totalImagesPullingTime="2.566354804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:07.305298775 +0000 UTC m=+445.114805958" watchObservedRunningTime="2026-06-03 23:32:07.305758563 +0000 UTC m=+445.115265744" Jun 03 23:32:08.366241 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.366206 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2"] Jun 03 23:32:08.368701 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.368684 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.371599 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.371580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:32:08.372994 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.372974 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m48wl\"" Jun 03 23:32:08.373102 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.372981 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:32:08.381824 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.381801 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2"] Jun 03 23:32:08.400953 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.400930 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvkq\" (UniqueName: \"kubernetes.io/projected/b653fafb-6e88-42d7-a96f-e4490489d2d9-kube-api-access-fhvkq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.401058 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.400978 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.401058 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.400995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.501386 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.501342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvkq\" (UniqueName: \"kubernetes.io/projected/b653fafb-6e88-42d7-a96f-e4490489d2d9-kube-api-access-fhvkq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.501516 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.501427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.501516 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.501454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.501844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.501826 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.501916 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.501855 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.510728 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.510708 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvkq\" (UniqueName: \"kubernetes.io/projected/b653fafb-6e88-42d7-a96f-e4490489d2d9-kube-api-access-fhvkq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.678036 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.677958 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:08.812166 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:08.812142 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2"] Jun 03 23:32:08.814105 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:08.814077 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb653fafb_6e88_42d7_a96f_e4490489d2d9.slice/crio-2635a21ef004db140fb51dd2872e59d958edbe71e97b632295c079199ffc148e WatchSource:0}: Error finding container 2635a21ef004db140fb51dd2872e59d958edbe71e97b632295c079199ffc148e: Status 404 returned error can't find the container with id 2635a21ef004db140fb51dd2872e59d958edbe71e97b632295c079199ffc148e Jun 03 23:32:09.292421 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:09.292390 2566 generic.go:356] "Generic (PLEG): container finished" podID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerID="bcfebf5cee8bbe37e0de82b20bf3dc99d327b112ad8899e43bc744c77572ae46" exitCode=0 Jun 03 23:32:09.292584 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:09.292473 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" event={"ID":"b653fafb-6e88-42d7-a96f-e4490489d2d9","Type":"ContainerDied","Data":"bcfebf5cee8bbe37e0de82b20bf3dc99d327b112ad8899e43bc744c77572ae46"} Jun 03 23:32:09.292584 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:09.292524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" event={"ID":"b653fafb-6e88-42d7-a96f-e4490489d2d9","Type":"ContainerStarted","Data":"2635a21ef004db140fb51dd2872e59d958edbe71e97b632295c079199ffc148e"} Jun 03 23:32:10.584086 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.584049 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-sf784"] Jun 03 23:32:10.586690 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.586668 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.593208 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.592946 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-p75wp\"" Jun 03 23:32:10.593208 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.593002 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 03 23:32:10.593208 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.593008 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 03 23:32:10.598991 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.598966 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-sf784"] Jun 03 23:32:10.622412 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.622389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/265323f3-5afc-4463-821d-ad6c3da92b7e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-sf784\" (UID: \"265323f3-5afc-4463-821d-ad6c3da92b7e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.622529 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.622434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lx5m\" (UniqueName: \"kubernetes.io/projected/265323f3-5afc-4463-821d-ad6c3da92b7e-kube-api-access-6lx5m\") pod \"cert-manager-webhook-7dc76cbb94-sf784\" (UID: \"265323f3-5afc-4463-821d-ad6c3da92b7e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.723609 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.723575 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/265323f3-5afc-4463-821d-ad6c3da92b7e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-sf784\" (UID: \"265323f3-5afc-4463-821d-ad6c3da92b7e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.723785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.723726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lx5m\" (UniqueName: \"kubernetes.io/projected/265323f3-5afc-4463-821d-ad6c3da92b7e-kube-api-access-6lx5m\") pod \"cert-manager-webhook-7dc76cbb94-sf784\" (UID: \"265323f3-5afc-4463-821d-ad6c3da92b7e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.734263 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.734239 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/265323f3-5afc-4463-821d-ad6c3da92b7e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-sf784\" (UID: \"265323f3-5afc-4463-821d-ad6c3da92b7e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.734649 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.734630 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lx5m\" (UniqueName: \"kubernetes.io/projected/265323f3-5afc-4463-821d-ad6c3da92b7e-kube-api-access-6lx5m\") pod \"cert-manager-webhook-7dc76cbb94-sf784\" (UID: \"265323f3-5afc-4463-821d-ad6c3da92b7e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:10.906006 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:10.905936 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:11.049442 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:11.049417 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-sf784"] Jun 03 23:32:11.051912 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:11.051889 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod265323f3_5afc_4463_821d_ad6c3da92b7e.slice/crio-5b62ae5ff7ad0bed3021e063413368b545cf1e9c475fe21299e48ed2682bc9bb WatchSource:0}: Error finding container 5b62ae5ff7ad0bed3021e063413368b545cf1e9c475fe21299e48ed2682bc9bb: Status 404 returned error can't find the container with id 5b62ae5ff7ad0bed3021e063413368b545cf1e9c475fe21299e48ed2682bc9bb Jun 03 23:32:11.304189 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:11.304153 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" event={"ID":"265323f3-5afc-4463-821d-ad6c3da92b7e","Type":"ContainerStarted","Data":"5b62ae5ff7ad0bed3021e063413368b545cf1e9c475fe21299e48ed2682bc9bb"} Jun 03 23:32:12.314146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:12.314049 2566 generic.go:356] "Generic (PLEG): container finished" podID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerID="e54cefe60e8ad0f1458c249ce298f29638ea3672e3544966c8183d9fd3e0aa9b" exitCode=0 Jun 03 23:32:12.314546 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:12.314140 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" event={"ID":"b653fafb-6e88-42d7-a96f-e4490489d2d9","Type":"ContainerDied","Data":"e54cefe60e8ad0f1458c249ce298f29638ea3672e3544966c8183d9fd3e0aa9b"} Jun 03 23:32:13.321713 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:13.321676 2566 generic.go:356] "Generic (PLEG): container finished" podID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerID="85b62e9441a80b72a9a843c129fc43a0799be214bbd490f3cbe6491c9035618e" exitCode=0 Jun 03 23:32:13.322112 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:13.321773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" event={"ID":"b653fafb-6e88-42d7-a96f-e4490489d2d9","Type":"ContainerDied","Data":"85b62e9441a80b72a9a843c129fc43a0799be214bbd490f3cbe6491c9035618e"} Jun 03 23:32:14.327816 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.327773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" event={"ID":"265323f3-5afc-4463-821d-ad6c3da92b7e","Type":"ContainerStarted","Data":"57c4bb679b5ff7c458c3126eb835cb6c5cc730cabdf3eb503981804f1c75c3a2"} Jun 03 23:32:14.328270 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.328061 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:14.346208 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.346148 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" podStartSLOduration=1.545602326 podStartE2EDuration="4.346132371s" totalImagesPullingTime="2.800530045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:14.344777091 +0000 UTC m=+452.154284294" watchObservedRunningTime="2026-06-03 23:32:14.346132371 +0000 UTC m=+452.155639553" Jun 03 23:32:14.475724 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.475703 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:14.560739 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.560716 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-bundle\") pod \"b653fafb-6e88-42d7-a96f-e4490489d2d9\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " Jun 03 23:32:14.560871 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.560770 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhvkq\" (UniqueName: \"kubernetes.io/projected/b653fafb-6e88-42d7-a96f-e4490489d2d9-kube-api-access-fhvkq\") pod \"b653fafb-6e88-42d7-a96f-e4490489d2d9\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " Jun 03 23:32:14.560871 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.560801 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-util\") pod \"b653fafb-6e88-42d7-a96f-e4490489d2d9\" (UID: \"b653fafb-6e88-42d7-a96f-e4490489d2d9\") " Jun 03 23:32:14.561086 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.561058 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-bundle" (OuterVolumeSpecName: "bundle") pod "b653fafb-6e88-42d7-a96f-e4490489d2d9" (UID: "b653fafb-6e88-42d7-a96f-e4490489d2d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:32:14.562943 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.562922 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b653fafb-6e88-42d7-a96f-e4490489d2d9-kube-api-access-fhvkq" (OuterVolumeSpecName: "kube-api-access-fhvkq") pod "b653fafb-6e88-42d7-a96f-e4490489d2d9" (UID: "b653fafb-6e88-42d7-a96f-e4490489d2d9"). InnerVolumeSpecName "kube-api-access-fhvkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:32:14.566179 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.566137 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-util" (OuterVolumeSpecName: "util") pod "b653fafb-6e88-42d7-a96f-e4490489d2d9" (UID: "b653fafb-6e88-42d7-a96f-e4490489d2d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:32:14.661835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.661765 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:32:14.661835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.661799 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhvkq\" (UniqueName: \"kubernetes.io/projected/b653fafb-6e88-42d7-a96f-e4490489d2d9-kube-api-access-fhvkq\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:32:14.661835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:14.661816 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b653fafb-6e88-42d7-a96f-e4490489d2d9-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:32:15.334114 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:15.334087 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" Jun 03 23:32:15.334570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:15.334127 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnkzm2" event={"ID":"b653fafb-6e88-42d7-a96f-e4490489d2d9","Type":"ContainerDied","Data":"2635a21ef004db140fb51dd2872e59d958edbe71e97b632295c079199ffc148e"} Jun 03 23:32:15.334570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:15.334175 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2635a21ef004db140fb51dd2872e59d958edbe71e97b632295c079199ffc148e" Jun 03 23:32:19.442749 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.442708 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4g5s"] Jun 03 23:32:19.443295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443178 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="util" Jun 03 23:32:19.443295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443199 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="util" Jun 03 23:32:19.443295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443230 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="pull" Jun 03 23:32:19.443295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443237 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="pull" Jun 03 23:32:19.443295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443247 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="extract" Jun 03 23:32:19.443295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443256 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="extract" Jun 03 23:32:19.443630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.443374 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b653fafb-6e88-42d7-a96f-e4490489d2d9" containerName="extract" Jun 03 23:32:19.446544 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.446522 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.449259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.449237 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tbjj5\"" Jun 03 23:32:19.455555 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.455533 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4g5s"] Jun 03 23:32:19.500570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.500540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/652b9a5d-c6ef-43a5-ac63-aaf24b57ee67-bound-sa-token\") pod \"cert-manager-59c77684cc-h4g5s\" (UID: \"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67\") " pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.500570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.500573 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwndf\" (UniqueName: \"kubernetes.io/projected/652b9a5d-c6ef-43a5-ac63-aaf24b57ee67-kube-api-access-jwndf\") pod \"cert-manager-59c77684cc-h4g5s\" (UID: \"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67\") " pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.602014 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.601983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/652b9a5d-c6ef-43a5-ac63-aaf24b57ee67-bound-sa-token\") pod \"cert-manager-59c77684cc-h4g5s\" (UID: \"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67\") " pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.602014 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.602018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwndf\" (UniqueName: \"kubernetes.io/projected/652b9a5d-c6ef-43a5-ac63-aaf24b57ee67-kube-api-access-jwndf\") pod \"cert-manager-59c77684cc-h4g5s\" (UID: \"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67\") " pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.610402 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.610375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/652b9a5d-c6ef-43a5-ac63-aaf24b57ee67-bound-sa-token\") pod \"cert-manager-59c77684cc-h4g5s\" (UID: \"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67\") " pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.610545 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.610527 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwndf\" (UniqueName: \"kubernetes.io/projected/652b9a5d-c6ef-43a5-ac63-aaf24b57ee67-kube-api-access-jwndf\") pod \"cert-manager-59c77684cc-h4g5s\" (UID: \"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67\") " pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.755554 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.755530 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-h4g5s" Jun 03 23:32:19.892636 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:19.891101 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-h4g5s"] Jun 03 23:32:19.896595 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:19.896572 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod652b9a5d_c6ef_43a5_ac63_aaf24b57ee67.slice/crio-4b761671bcf823cf46573e3c6714bfbca97e3f5b1ce86b0cad4ef0547dc69c5b WatchSource:0}: Error finding container 4b761671bcf823cf46573e3c6714bfbca97e3f5b1ce86b0cad4ef0547dc69c5b: Status 404 returned error can't find the container with id 4b761671bcf823cf46573e3c6714bfbca97e3f5b1ce86b0cad4ef0547dc69c5b Jun 03 23:32:20.336832 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:20.336806 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-sf784" Jun 03 23:32:20.357190 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:20.357157 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h4g5s" event={"ID":"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67","Type":"ContainerStarted","Data":"3024e70307dd0a3ebd9e596b73f674041ac8e3c6080b0b0d0226b143fa5fb0c9"} Jun 03 23:32:20.357353 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:20.357201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-h4g5s" event={"ID":"652b9a5d-c6ef-43a5-ac63-aaf24b57ee67","Type":"ContainerStarted","Data":"4b761671bcf823cf46573e3c6714bfbca97e3f5b1ce86b0cad4ef0547dc69c5b"} Jun 03 23:32:20.375343 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:20.374775 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-h4g5s" podStartSLOduration=1.3747550259999999 podStartE2EDuration="1.374755026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:20.373252342 +0000 UTC m=+458.182759525" watchObservedRunningTime="2026-06-03 23:32:20.374755026 +0000 UTC m=+458.184262208" Jun 03 23:32:28.179191 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.179157 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t"] Jun 03 23:32:28.184206 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.184187 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.187214 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.187195 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:32:28.187514 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.187493 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:32:28.188700 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.188680 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m48wl\"" Jun 03 23:32:28.192511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.192483 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t"] Jun 03 23:32:28.265827 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.265794 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x68gj\" (UniqueName: \"kubernetes.io/projected/315b73e8-3cbb-426f-87ea-d60422c1bc95-kube-api-access-x68gj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.265968 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.265845 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.265968 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.265953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.367282 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.367252 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x68gj\" (UniqueName: \"kubernetes.io/projected/315b73e8-3cbb-426f-87ea-d60422c1bc95-kube-api-access-x68gj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.367460 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.367294 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.367460 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.367358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.367651 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.367634 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.367719 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.367680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.375502 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.375472 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x68gj\" (UniqueName: \"kubernetes.io/projected/315b73e8-3cbb-426f-87ea-d60422c1bc95-kube-api-access-x68gj\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.495511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.495482 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:28.624085 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:28.624056 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t"] Jun 03 23:32:28.625547 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:28.625522 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315b73e8_3cbb_426f_87ea_d60422c1bc95.slice/crio-088c3f2dc4d01b9605dab52a6ea3d014b256b0458a3e4e51d37c8772f7dc5f1d WatchSource:0}: Error finding container 088c3f2dc4d01b9605dab52a6ea3d014b256b0458a3e4e51d37c8772f7dc5f1d: Status 404 returned error can't find the container with id 088c3f2dc4d01b9605dab52a6ea3d014b256b0458a3e4e51d37c8772f7dc5f1d Jun 03 23:32:29.399147 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:29.399117 2566 generic.go:356] "Generic (PLEG): container finished" podID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerID="74959bc829c0d6af6047b6b43e1e35dc790375c6dd8dd904b78a583bc5d0cf83" exitCode=0 Jun 03 23:32:29.399567 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:29.399204 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" event={"ID":"315b73e8-3cbb-426f-87ea-d60422c1bc95","Type":"ContainerDied","Data":"74959bc829c0d6af6047b6b43e1e35dc790375c6dd8dd904b78a583bc5d0cf83"} Jun 03 23:32:29.399567 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:29.399251 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" event={"ID":"315b73e8-3cbb-426f-87ea-d60422c1bc95","Type":"ContainerStarted","Data":"088c3f2dc4d01b9605dab52a6ea3d014b256b0458a3e4e51d37c8772f7dc5f1d"} Jun 03 23:32:30.405812 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:30.405775 2566 generic.go:356] "Generic (PLEG): container finished" podID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerID="5a50ae580edd9defa48104941a7ed6ec784032abb9785d1915a6a8e880dbb993" exitCode=0 Jun 03 23:32:30.406413 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:30.405858 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" event={"ID":"315b73e8-3cbb-426f-87ea-d60422c1bc95","Type":"ContainerDied","Data":"5a50ae580edd9defa48104941a7ed6ec784032abb9785d1915a6a8e880dbb993"} Jun 03 23:32:31.412176 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:31.412141 2566 generic.go:356] "Generic (PLEG): container finished" podID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerID="82f88f14e12c0d900f24a44e46d9de95fa7304122989e165ea1c6aff7e63895f" exitCode=0 Jun 03 23:32:31.412176 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:31.412176 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" event={"ID":"315b73e8-3cbb-426f-87ea-d60422c1bc95","Type":"ContainerDied","Data":"82f88f14e12c0d900f24a44e46d9de95fa7304122989e165ea1c6aff7e63895f"} Jun 03 23:32:32.551970 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.551940 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:32.705738 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.705716 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-bundle\") pod \"315b73e8-3cbb-426f-87ea-d60422c1bc95\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " Jun 03 23:32:32.705877 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.705808 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-util\") pod \"315b73e8-3cbb-426f-87ea-d60422c1bc95\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " Jun 03 23:32:32.705877 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.705869 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x68gj\" (UniqueName: \"kubernetes.io/projected/315b73e8-3cbb-426f-87ea-d60422c1bc95-kube-api-access-x68gj\") pod \"315b73e8-3cbb-426f-87ea-d60422c1bc95\" (UID: \"315b73e8-3cbb-426f-87ea-d60422c1bc95\") " Jun 03 23:32:32.706558 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.706528 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-bundle" (OuterVolumeSpecName: "bundle") pod "315b73e8-3cbb-426f-87ea-d60422c1bc95" (UID: "315b73e8-3cbb-426f-87ea-d60422c1bc95"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:32:32.708062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.708040 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/315b73e8-3cbb-426f-87ea-d60422c1bc95-kube-api-access-x68gj" (OuterVolumeSpecName: "kube-api-access-x68gj") pod "315b73e8-3cbb-426f-87ea-d60422c1bc95" (UID: "315b73e8-3cbb-426f-87ea-d60422c1bc95"). InnerVolumeSpecName "kube-api-access-x68gj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:32:32.711856 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.711835 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-util" (OuterVolumeSpecName: "util") pod "315b73e8-3cbb-426f-87ea-d60422c1bc95" (UID: "315b73e8-3cbb-426f-87ea-d60422c1bc95"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:32:32.807121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.807094 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x68gj\" (UniqueName: \"kubernetes.io/projected/315b73e8-3cbb-426f-87ea-d60422c1bc95-kube-api-access-x68gj\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:32:32.807121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.807119 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:32:32.807121 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:32.807127 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/315b73e8-3cbb-426f-87ea-d60422c1bc95-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:32:33.422945 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:33.422918 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" Jun 03 23:32:33.423120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:33.422940 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd8xw2t" event={"ID":"315b73e8-3cbb-426f-87ea-d60422c1bc95","Type":"ContainerDied","Data":"088c3f2dc4d01b9605dab52a6ea3d014b256b0458a3e4e51d37c8772f7dc5f1d"} Jun 03 23:32:33.423120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:33.422988 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="088c3f2dc4d01b9605dab52a6ea3d014b256b0458a3e4e51d37c8772f7dc5f1d" Jun 03 23:32:44.829755 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.829714 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4"] Jun 03 23:32:44.830247 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830200 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="util" Jun 03 23:32:44.830247 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830217 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="util" Jun 03 23:32:44.830247 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830234 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="extract" Jun 03 23:32:44.830247 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830242 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="extract" Jun 03 23:32:44.830485 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830252 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="pull" Jun 03 23:32:44.830485 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830260 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="pull" Jun 03 23:32:44.830485 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.830379 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="315b73e8-3cbb-426f-87ea-d60422c1bc95" containerName="extract" Jun 03 23:32:44.833022 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.833001 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:44.837711 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.837687 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zfszn\"" Jun 03 23:32:44.837711 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.837701 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 03 23:32:44.837879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.837687 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 03 23:32:44.837879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.837688 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 03 23:32:44.837879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.837693 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 03 23:32:44.837879 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.837777 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 03 23:32:44.851766 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:44.851746 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4"] Jun 03 23:32:45.004028 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.003998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-cert\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.004214 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.004035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-metrics-cert\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.004214 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.004125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-manager-config\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.004348 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.004207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9lv\" (UniqueName: \"kubernetes.io/projected/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-kube-api-access-zv9lv\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.105145 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.105067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9lv\" (UniqueName: \"kubernetes.io/projected/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-kube-api-access-zv9lv\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.105145 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.105114 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-cert\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.105145 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.105133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-metrics-cert\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.105428 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.105177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-manager-config\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.105816 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.105794 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-manager-config\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.107751 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.107730 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-metrics-cert\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.107842 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.107782 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-cert\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.118900 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.118882 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9lv\" (UniqueName: \"kubernetes.io/projected/ffdd2d6e-8e7e-40af-aeae-697668e9bb21-kube-api-access-zv9lv\") pod \"lws-controller-manager-869fd7c4f4-wvwv4\" (UID: \"ffdd2d6e-8e7e-40af-aeae-697668e9bb21\") " pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.142405 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.142380 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:45.309802 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.309780 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf"] Jun 03 23:32:45.311767 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:45.311739 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdd2d6e_8e7e_40af_aeae_697668e9bb21.slice/crio-6a111d20d45ba324aac088813146cd522915ba9e6f10e82a735cc3bf588b9660 WatchSource:0}: Error finding container 6a111d20d45ba324aac088813146cd522915ba9e6f10e82a735cc3bf588b9660: Status 404 returned error can't find the container with id 6a111d20d45ba324aac088813146cd522915ba9e6f10e82a735cc3bf588b9660 Jun 03 23:32:45.313299 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.313280 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4"] Jun 03 23:32:45.313466 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.313383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.316268 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.316246 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 03 23:32:45.316383 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.316298 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 03 23:32:45.316383 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.316351 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 03 23:32:45.316383 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.316362 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 03 23:32:45.316816 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.316798 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-sj8gs\"" Jun 03 23:32:45.330919 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.330895 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf"] Jun 03 23:32:45.409638 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.409565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkncc\" (UniqueName: \"kubernetes.io/projected/d4891b38-234b-48eb-830c-b51bb63f12d1-kube-api-access-mkncc\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.409638 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.409598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4891b38-234b-48eb-830c-b51bb63f12d1-manifests\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.409638 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.409624 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4891b38-234b-48eb-830c-b51bb63f12d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.409829 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.409733 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4891b38-234b-48eb-830c-b51bb63f12d1-tmp\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.409829 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.409769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4891b38-234b-48eb-830c-b51bb63f12d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.478684 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.478654 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" event={"ID":"ffdd2d6e-8e7e-40af-aeae-697668e9bb21","Type":"ContainerStarted","Data":"6a111d20d45ba324aac088813146cd522915ba9e6f10e82a735cc3bf588b9660"} Jun 03 23:32:45.511014 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.510984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4891b38-234b-48eb-830c-b51bb63f12d1-tmp\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.511159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.511020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4891b38-234b-48eb-830c-b51bb63f12d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.511159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.511070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkncc\" (UniqueName: \"kubernetes.io/projected/d4891b38-234b-48eb-830c-b51bb63f12d1-kube-api-access-mkncc\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.511159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.511087 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4891b38-234b-48eb-830c-b51bb63f12d1-manifests\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.511159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.511107 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4891b38-234b-48eb-830c-b51bb63f12d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.511477 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.511459 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d4891b38-234b-48eb-830c-b51bb63f12d1-manifests\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.513573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.513549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4891b38-234b-48eb-830c-b51bb63f12d1-tmp\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.513702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.513685 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d4891b38-234b-48eb-830c-b51bb63f12d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.513702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.513695 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d4891b38-234b-48eb-830c-b51bb63f12d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.523538 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.523521 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkncc\" (UniqueName: \"kubernetes.io/projected/d4891b38-234b-48eb-830c-b51bb63f12d1-kube-api-access-mkncc\") pod \"opendatahub-operator-controller-manager-684bd49f57-qz6gf\" (UID: \"d4891b38-234b-48eb-830c-b51bb63f12d1\") " pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.624076 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.624057 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:45.762991 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:45.762965 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf"] Jun 03 23:32:45.765266 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:32:45.765243 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4891b38_234b_48eb_830c_b51bb63f12d1.slice/crio-ac58e199f06c0e2a8166be892a0adc437ccfa819d8cef14e6ac3b7d9731d8636 WatchSource:0}: Error finding container ac58e199f06c0e2a8166be892a0adc437ccfa819d8cef14e6ac3b7d9731d8636: Status 404 returned error can't find the container with id ac58e199f06c0e2a8166be892a0adc437ccfa819d8cef14e6ac3b7d9731d8636 Jun 03 23:32:46.492631 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:46.492369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" event={"ID":"d4891b38-234b-48eb-830c-b51bb63f12d1","Type":"ContainerStarted","Data":"ac58e199f06c0e2a8166be892a0adc437ccfa819d8cef14e6ac3b7d9731d8636"} Jun 03 23:32:49.509687 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:49.509650 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" event={"ID":"ffdd2d6e-8e7e-40af-aeae-697668e9bb21","Type":"ContainerStarted","Data":"e056e1f8d58dfe36ae9387d5e11150516735f054fbc47b761cd0acdaeeadc258"} Jun 03 23:32:49.510141 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:49.509766 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:32:49.511145 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:49.511118 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" event={"ID":"d4891b38-234b-48eb-830c-b51bb63f12d1","Type":"ContainerStarted","Data":"455c86124bb81183dcbd06a8c284ca5d039a057f353f2e77eb9fcb7c8f688804"} Jun 03 23:32:49.532662 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:49.532617 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" podStartSLOduration=2.179549535 podStartE2EDuration="5.532603929s" totalImagesPullingTime="3.353054394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:49.531846049 +0000 UTC m=+487.341353246" watchObservedRunningTime="2026-06-03 23:32:49.532603929 +0000 UTC m=+487.342111109" Jun 03 23:32:50.517649 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:50.517616 2566 generic.go:356] "Generic (PLEG): container finished" podID="d4891b38-234b-48eb-830c-b51bb63f12d1" containerID="455c86124bb81183dcbd06a8c284ca5d039a057f353f2e77eb9fcb7c8f688804" exitCode=0 Jun 03 23:32:50.518036 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:50.517694 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" event={"ID":"d4891b38-234b-48eb-830c-b51bb63f12d1","Type":"ContainerDied","Data":"455c86124bb81183dcbd06a8c284ca5d039a057f353f2e77eb9fcb7c8f688804"} Jun 03 23:32:51.526242 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:51.526195 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" event={"ID":"d4891b38-234b-48eb-830c-b51bb63f12d1","Type":"ContainerStarted","Data":"d7a4ed89a99fba3da5f6f5e4c50eb3f17e66c3b252f727279c5299aef5c4a109"} Jun 03 23:32:51.526693 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:51.526312 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:32:51.550362 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:32:51.550296 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" podStartSLOduration=2.369153939 podStartE2EDuration="6.550281289s" totalImagesPullingTime="3.248067132s" totalInitContainerRuntime="933.060218ms" isStatefulPod=false podCreationTimestamp="2026-06-03 23:32:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:32:51.548596535 +0000 UTC m=+489.358103713" watchObservedRunningTime="2026-06-03 23:32:51.550281289 +0000 UTC m=+489.359788470" Jun 03 23:33:00.520397 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:00.520368 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-869fd7c4f4-wvwv4" Jun 03 23:33:02.533274 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:02.533246 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-684bd49f57-qz6gf" Jun 03 23:33:05.815630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.815586 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x"] Jun 03 23:33:05.825513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.825488 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.833157 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.833118 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x"] Jun 03 23:33:05.835218 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.835200 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 03 23:33:05.835396 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.835373 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 03 23:33:05.835499 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.835248 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j5hqd\"" Jun 03 23:33:05.836008 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.835987 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 03 23:33:05.836107 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.835991 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 03 23:33:05.854519 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.854494 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn"] Jun 03 23:33:05.856892 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.856876 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.862259 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.862238 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpcpb\" (UniqueName: \"kubernetes.io/projected/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-kube-api-access-bpcpb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.862391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.862297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tls-certs\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.862391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.862363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tmp\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.862391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.862383 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.862570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.862400 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.862570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.862510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scch2\" (UniqueName: \"kubernetes.io/projected/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-kube-api-access-scch2\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.864242 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.864220 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:33:05.864380 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.864344 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m48wl\"" Jun 03 23:33:05.864624 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.864604 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:33:05.909833 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.909808 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn"] Jun 03 23:33:05.962926 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.962897 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scch2\" (UniqueName: \"kubernetes.io/projected/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-kube-api-access-scch2\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.963104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.962938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpcpb\" (UniqueName: \"kubernetes.io/projected/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-kube-api-access-bpcpb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.963104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.962979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tls-certs\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.963104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.962997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tmp\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.963104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.963013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.963104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.963035 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.963104 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:33:05.963092 2566 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 03 23:33:05.963533 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:33:05.963157 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tls-certs podName:b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85 nodeName:}" failed. No retries permitted until 2026-06-03 23:33:06.463137777 +0000 UTC m=+504.272644941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tls-certs") pod "kube-auth-proxy-5b845bc8d9-dxl2x" (UID: "b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85") : secret "kube-auth-proxy-tls" not found Jun 03 23:33:05.963611 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.963555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.963611 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.963555 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.965466 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.965443 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tmp\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:05.994769 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.994742 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpcpb\" (UniqueName: \"kubernetes.io/projected/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-kube-api-access-bpcpb\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:05.996888 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:05.996864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scch2\" (UniqueName: \"kubernetes.io/projected/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-kube-api-access-scch2\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:06.166040 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.165954 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:06.325264 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.325216 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn"] Jun 03 23:33:06.329458 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:33:06.329430 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod621b9cdb_bb46_4bcb_8632_36fc61b6df6c.slice/crio-74ad0a0975c6da1b9a8690daf275542d8407549e1c887ddc126813bacb89e033 WatchSource:0}: Error finding container 74ad0a0975c6da1b9a8690daf275542d8407549e1c887ddc126813bacb89e033: Status 404 returned error can't find the container with id 74ad0a0975c6da1b9a8690daf275542d8407549e1c887ddc126813bacb89e033 Jun 03 23:33:06.465938 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.465911 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tls-certs\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:06.468298 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.468279 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85-tls-certs\") pod \"kube-auth-proxy-5b845bc8d9-dxl2x\" (UID: \"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85\") " pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:06.603662 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.603623 2566 generic.go:356] "Generic (PLEG): container finished" podID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerID="49864c518b51ad4b40d825894153c7f42d72cb5d83d74a8b2d42d281e5935c2b" exitCode=0 Jun 03 23:33:06.603861 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.603715 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" event={"ID":"621b9cdb-bb46-4bcb-8632-36fc61b6df6c","Type":"ContainerDied","Data":"49864c518b51ad4b40d825894153c7f42d72cb5d83d74a8b2d42d281e5935c2b"} Jun 03 23:33:06.603861 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.603780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" event={"ID":"621b9cdb-bb46-4bcb-8632-36fc61b6df6c","Type":"ContainerStarted","Data":"74ad0a0975c6da1b9a8690daf275542d8407549e1c887ddc126813bacb89e033"} Jun 03 23:33:06.738420 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.738393 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" Jun 03 23:33:06.910569 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:06.910539 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x"] Jun 03 23:33:06.913202 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:33:06.913172 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a16f03_7dcd_4ef3_8bc8_70ad11bbfc85.slice/crio-59332130a483deb2ff914538ca481e5267e37a7418b7e9a7aa97d69dde045293 WatchSource:0}: Error finding container 59332130a483deb2ff914538ca481e5267e37a7418b7e9a7aa97d69dde045293: Status 404 returned error can't find the container with id 59332130a483deb2ff914538ca481e5267e37a7418b7e9a7aa97d69dde045293 Jun 03 23:33:07.613487 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:07.613451 2566 generic.go:356] "Generic (PLEG): container finished" podID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerID="7596e07ce9105101e23a2d2cb0f7614184f1fbfba7af08128d0cababb5f48271" exitCode=0 Jun 03 23:33:07.613658 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:07.613547 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" event={"ID":"621b9cdb-bb46-4bcb-8632-36fc61b6df6c","Type":"ContainerDied","Data":"7596e07ce9105101e23a2d2cb0f7614184f1fbfba7af08128d0cababb5f48271"} Jun 03 23:33:07.617403 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:07.617359 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" event={"ID":"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85","Type":"ContainerStarted","Data":"59332130a483deb2ff914538ca481e5267e37a7418b7e9a7aa97d69dde045293"} Jun 03 23:33:08.626120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:08.626082 2566 generic.go:356] "Generic (PLEG): container finished" podID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerID="31346428897e3c8d0fd2c3f9c93b8be9846b685237f0b7d1a8621ba320faae07" exitCode=0 Jun 03 23:33:08.626629 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:08.626167 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" event={"ID":"621b9cdb-bb46-4bcb-8632-36fc61b6df6c","Type":"ContainerDied","Data":"31346428897e3c8d0fd2c3f9c93b8be9846b685237f0b7d1a8621ba320faae07"} Jun 03 23:33:09.782545 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.782514 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:09.803848 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.803358 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-bundle\") pod \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " Jun 03 23:33:09.803848 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.803457 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpcpb\" (UniqueName: \"kubernetes.io/projected/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-kube-api-access-bpcpb\") pod \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " Jun 03 23:33:09.803848 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.803550 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-util\") pod \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\" (UID: \"621b9cdb-bb46-4bcb-8632-36fc61b6df6c\") " Jun 03 23:33:09.805070 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.804824 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-bundle" (OuterVolumeSpecName: "bundle") pod "621b9cdb-bb46-4bcb-8632-36fc61b6df6c" (UID: "621b9cdb-bb46-4bcb-8632-36fc61b6df6c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:09.807057 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.807020 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-kube-api-access-bpcpb" (OuterVolumeSpecName: "kube-api-access-bpcpb") pod "621b9cdb-bb46-4bcb-8632-36fc61b6df6c" (UID: "621b9cdb-bb46-4bcb-8632-36fc61b6df6c"). InnerVolumeSpecName "kube-api-access-bpcpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:33:09.810836 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.810808 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-util" (OuterVolumeSpecName: "util") pod "621b9cdb-bb46-4bcb-8632-36fc61b6df6c" (UID: "621b9cdb-bb46-4bcb-8632-36fc61b6df6c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:09.905030 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.904934 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:33:09.905030 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.904969 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:33:09.905030 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:09.904982 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpcpb\" (UniqueName: \"kubernetes.io/projected/621b9cdb-bb46-4bcb-8632-36fc61b6df6c-kube-api-access-bpcpb\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:33:10.639781 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:10.639752 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" Jun 03 23:33:10.639990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:10.639735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06hbvtn" event={"ID":"621b9cdb-bb46-4bcb-8632-36fc61b6df6c","Type":"ContainerDied","Data":"74ad0a0975c6da1b9a8690daf275542d8407549e1c887ddc126813bacb89e033"} Jun 03 23:33:10.639990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:10.639891 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74ad0a0975c6da1b9a8690daf275542d8407549e1c887ddc126813bacb89e033" Jun 03 23:33:10.641524 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:10.641495 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" event={"ID":"b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85","Type":"ContainerStarted","Data":"22fd4ef9aa7283dc5c0a750ff3bdb31259a06b161f1e2386c0ceeab252ecf4f5"} Jun 03 23:33:10.661355 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:10.661290 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5b845bc8d9-dxl2x" podStartSLOduration=2.762409599 podStartE2EDuration="5.661277887s" totalImagesPullingTime="2.898868288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:33:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:33:10.659953271 +0000 UTC m=+508.469460454" watchObservedRunningTime="2026-06-03 23:33:10.661277887 +0000 UTC m=+508.470785098" Jun 03 23:33:15.096130 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096095 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj"] Jun 03 23:33:15.096598 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096581 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="pull" Jun 03 23:33:15.096666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096601 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="pull" Jun 03 23:33:15.096666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096624 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="util" Jun 03 23:33:15.096666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096629 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="util" Jun 03 23:33:15.096666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096635 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="extract" Jun 03 23:33:15.096666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096642 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="extract" Jun 03 23:33:15.096824 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.096709 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="621b9cdb-bb46-4bcb-8632-36fc61b6df6c" containerName="extract" Jun 03 23:33:15.100099 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.100084 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.104596 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.104567 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m48wl\"" Jun 03 23:33:15.104596 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.104585 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:33:15.105844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.105824 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:33:15.113662 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.113638 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj"] Jun 03 23:33:15.148963 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.148933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.149082 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.149026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.149143 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.149084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9j6c\" (UniqueName: \"kubernetes.io/projected/2566e7b1-1e51-4b78-9fbf-4854708df82f-kube-api-access-v9j6c\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.250248 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.250217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9j6c\" (UniqueName: \"kubernetes.io/projected/2566e7b1-1e51-4b78-9fbf-4854708df82f-kube-api-access-v9j6c\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.250456 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.250269 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.250456 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.250391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.250731 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.250712 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.250767 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.250737 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.276763 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.276729 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9j6c\" (UniqueName: \"kubernetes.io/projected/2566e7b1-1e51-4b78-9fbf-4854708df82f-kube-api-access-v9j6c\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.409607 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.409526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:15.573339 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.573298 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj"] Jun 03 23:33:15.574425 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:33:15.574394 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2566e7b1_1e51_4b78_9fbf_4854708df82f.slice/crio-fe83e02c14a9964b25b036bb813777954ab3516ade6e67343f12893a24c43273 WatchSource:0}: Error finding container fe83e02c14a9964b25b036bb813777954ab3516ade6e67343f12893a24c43273: Status 404 returned error can't find the container with id fe83e02c14a9964b25b036bb813777954ab3516ade6e67343f12893a24c43273 Jun 03 23:33:15.669060 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.668946 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" event={"ID":"2566e7b1-1e51-4b78-9fbf-4854708df82f","Type":"ContainerStarted","Data":"4a4f12b3a3ec22db71f60cc7ddd2433ac8bee2eacc78cd040faa9b01c9fc8ab5"} Jun 03 23:33:15.669060 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:15.669008 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" event={"ID":"2566e7b1-1e51-4b78-9fbf-4854708df82f","Type":"ContainerStarted","Data":"fe83e02c14a9964b25b036bb813777954ab3516ade6e67343f12893a24c43273"} Jun 03 23:33:16.677050 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:16.676949 2566 generic.go:356] "Generic (PLEG): container finished" podID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerID="4a4f12b3a3ec22db71f60cc7ddd2433ac8bee2eacc78cd040faa9b01c9fc8ab5" exitCode=0 Jun 03 23:33:16.677508 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:16.677057 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" event={"ID":"2566e7b1-1e51-4b78-9fbf-4854708df82f","Type":"ContainerDied","Data":"4a4f12b3a3ec22db71f60cc7ddd2433ac8bee2eacc78cd040faa9b01c9fc8ab5"} Jun 03 23:33:17.683858 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:17.683828 2566 generic.go:356] "Generic (PLEG): container finished" podID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerID="5c73c0d5edb9789ee4c3704d50e211026220b43ff0eae4338a7856fa56f3d771" exitCode=0 Jun 03 23:33:17.684227 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:17.683898 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" event={"ID":"2566e7b1-1e51-4b78-9fbf-4854708df82f","Type":"ContainerDied","Data":"5c73c0d5edb9789ee4c3704d50e211026220b43ff0eae4338a7856fa56f3d771"} Jun 03 23:33:18.693439 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:18.693401 2566 generic.go:356] "Generic (PLEG): container finished" podID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerID="6eeee86b7ee72fe8211e91e67295ad44d8920ff1971bdf01b3afb6b3700ed460" exitCode=0 Jun 03 23:33:18.694012 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:18.693528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" event={"ID":"2566e7b1-1e51-4b78-9fbf-4854708df82f","Type":"ContainerDied","Data":"6eeee86b7ee72fe8211e91e67295ad44d8920ff1971bdf01b3afb6b3700ed460"} Jun 03 23:33:19.827905 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.827884 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:33:19.892770 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.892742 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9j6c\" (UniqueName: \"kubernetes.io/projected/2566e7b1-1e51-4b78-9fbf-4854708df82f-kube-api-access-v9j6c\") pod \"2566e7b1-1e51-4b78-9fbf-4854708df82f\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " Jun 03 23:33:19.892897 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.892781 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-bundle\") pod \"2566e7b1-1e51-4b78-9fbf-4854708df82f\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " Jun 03 23:33:19.892897 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.892830 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-util\") pod \"2566e7b1-1e51-4b78-9fbf-4854708df82f\" (UID: \"2566e7b1-1e51-4b78-9fbf-4854708df82f\") " Jun 03 23:33:19.893868 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.893838 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-bundle" (OuterVolumeSpecName: "bundle") pod "2566e7b1-1e51-4b78-9fbf-4854708df82f" (UID: "2566e7b1-1e51-4b78-9fbf-4854708df82f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:19.895136 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.895113 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2566e7b1-1e51-4b78-9fbf-4854708df82f-kube-api-access-v9j6c" (OuterVolumeSpecName: "kube-api-access-v9j6c") pod "2566e7b1-1e51-4b78-9fbf-4854708df82f" (UID: "2566e7b1-1e51-4b78-9fbf-4854708df82f"). InnerVolumeSpecName "kube-api-access-v9j6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:33:19.898221 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.898199 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-util" (OuterVolumeSpecName: "util") pod "2566e7b1-1e51-4b78-9fbf-4854708df82f" (UID: "2566e7b1-1e51-4b78-9fbf-4854708df82f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:33:19.993574 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.993549 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9j6c\" (UniqueName: \"kubernetes.io/projected/2566e7b1-1e51-4b78-9fbf-4854708df82f-kube-api-access-v9j6c\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:33:19.993574 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.993572 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:33:19.993701 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:19.993581 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2566e7b1-1e51-4b78-9fbf-4854708df82f-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:33:20.704504 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:20.704476 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" event={"ID":"2566e7b1-1e51-4b78-9fbf-4854708df82f","Type":"ContainerDied","Data":"fe83e02c14a9964b25b036bb813777954ab3516ade6e67343f12893a24c43273"} Jun 03 23:33:20.704634 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:20.704518 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe83e02c14a9964b25b036bb813777954ab3516ade6e67343f12893a24c43273" Jun 03 23:33:20.704634 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:33:20.704518 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762afknmj" Jun 03 23:34:22.036759 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.036717 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt"] Jun 03 23:34:22.037244 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037113 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="util" Jun 03 23:34:22.037244 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037130 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="util" Jun 03 23:34:22.037244 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037148 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="extract" Jun 03 23:34:22.037244 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037157 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="extract" Jun 03 23:34:22.037244 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037177 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="pull" Jun 03 23:34:22.037244 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037186 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="pull" Jun 03 23:34:22.037526 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.037283 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2566e7b1-1e51-4b78-9fbf-4854708df82f" containerName="extract" Jun 03 23:34:22.040791 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.040773 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.043882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.043862 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:34:22.044008 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.043894 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:34:22.045102 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.045081 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tvmwh\"" Jun 03 23:34:22.050867 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.050844 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt"] Jun 03 23:34:22.111824 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.111787 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.111994 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.111883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.111994 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.111918 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4rpz\" (UniqueName: \"kubernetes.io/projected/a3130bc2-b082-4009-9af3-aab06f4c9f21-kube-api-access-g4rpz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.213249 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.213217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.213405 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.213305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.213405 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.213363 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4rpz\" (UniqueName: \"kubernetes.io/projected/a3130bc2-b082-4009-9af3-aab06f4c9f21-kube-api-access-g4rpz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.213615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.213597 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.213680 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.213641 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.222975 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.222951 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4rpz\" (UniqueName: \"kubernetes.io/projected/a3130bc2-b082-4009-9af3-aab06f4c9f21-kube-api-access-g4rpz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.351734 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.351651 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:22.496799 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.496770 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt"] Jun 03 23:34:22.497896 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:34:22.497873 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3130bc2_b082_4009_9af3_aab06f4c9f21.slice/crio-4fcc86e011516db3f401f2eb7f8a66601e4eee6a82d865ae52cc3c973deed10f WatchSource:0}: Error finding container 4fcc86e011516db3f401f2eb7f8a66601e4eee6a82d865ae52cc3c973deed10f: Status 404 returned error can't find the container with id 4fcc86e011516db3f401f2eb7f8a66601e4eee6a82d865ae52cc3c973deed10f Jun 03 23:34:22.843005 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.842970 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n"] Jun 03 23:34:22.846586 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.846567 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:22.857503 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.857473 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n"] Jun 03 23:34:22.919493 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.919466 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:22.919642 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.919568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:22.919642 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:22.919593 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zszvz\" (UniqueName: \"kubernetes.io/projected/41b9bf6f-c647-4174-bc16-2af5c4f17e67-kube-api-access-zszvz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.020113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.020079 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.020388 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.020189 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.020388 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.020221 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zszvz\" (UniqueName: \"kubernetes.io/projected/41b9bf6f-c647-4174-bc16-2af5c4f17e67-kube-api-access-zszvz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.020578 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.020553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.020628 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.020561 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.024271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.024235 2566 generic.go:356] "Generic (PLEG): container finished" podID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerID="dd1b5f25db9f35b21ad7a60016e59d13dc025f7c40ea11625eefa0cfa8b12aec" exitCode=0 Jun 03 23:34:23.024400 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.024317 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" event={"ID":"a3130bc2-b082-4009-9af3-aab06f4c9f21","Type":"ContainerDied","Data":"dd1b5f25db9f35b21ad7a60016e59d13dc025f7c40ea11625eefa0cfa8b12aec"} Jun 03 23:34:23.024400 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.024376 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" event={"ID":"a3130bc2-b082-4009-9af3-aab06f4c9f21","Type":"ContainerStarted","Data":"4fcc86e011516db3f401f2eb7f8a66601e4eee6a82d865ae52cc3c973deed10f"} Jun 03 23:34:23.034911 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.034892 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zszvz\" (UniqueName: \"kubernetes.io/projected/41b9bf6f-c647-4174-bc16-2af5c4f17e67-kube-api-access-zszvz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.156419 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.156363 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:23.290295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.290268 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n"] Jun 03 23:34:23.293017 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:34:23.292988 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b9bf6f_c647_4174_bc16_2af5c4f17e67.slice/crio-b84010b20fdc724edd16f5ac7bc2faea2aab865a6cc40f4feb94e27c32081ae9 WatchSource:0}: Error finding container b84010b20fdc724edd16f5ac7bc2faea2aab865a6cc40f4feb94e27c32081ae9: Status 404 returned error can't find the container with id b84010b20fdc724edd16f5ac7bc2faea2aab865a6cc40f4feb94e27c32081ae9 Jun 03 23:34:23.448459 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.448395 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv"] Jun 03 23:34:23.452137 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.452120 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.461838 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.461811 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv"] Jun 03 23:34:23.525776 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.525751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.525929 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.525820 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkj9t\" (UniqueName: \"kubernetes.io/projected/d655140d-3d9e-4385-8ff1-6b698b7a13f4-kube-api-access-tkj9t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.525929 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.525880 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.626790 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.626761 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.626790 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.626794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.627021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.626848 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkj9t\" (UniqueName: \"kubernetes.io/projected/d655140d-3d9e-4385-8ff1-6b698b7a13f4-kube-api-access-tkj9t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.627202 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.627180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.627339 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.627302 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.644055 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.644031 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkj9t\" (UniqueName: \"kubernetes.io/projected/d655140d-3d9e-4385-8ff1-6b698b7a13f4-kube-api-access-tkj9t\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.761582 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.761561 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:23.927500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:23.927459 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv"] Jun 03 23:34:23.931350 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:34:23.931304 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd655140d_3d9e_4385_8ff1_6b698b7a13f4.slice/crio-c4f99241ee7d138633f68056d498343cd56b0110843c20f159771a717405626f WatchSource:0}: Error finding container c4f99241ee7d138633f68056d498343cd56b0110843c20f159771a717405626f: Status 404 returned error can't find the container with id c4f99241ee7d138633f68056d498343cd56b0110843c20f159771a717405626f Jun 03 23:34:24.039233 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.039195 2566 generic.go:356] "Generic (PLEG): container finished" podID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerID="8afc22f4b2db147979b479bddf7782ba6ee81d2eeedee20797641dd371e7dc00" exitCode=0 Jun 03 23:34:24.039397 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.039257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" event={"ID":"a3130bc2-b082-4009-9af3-aab06f4c9f21","Type":"ContainerDied","Data":"8afc22f4b2db147979b479bddf7782ba6ee81d2eeedee20797641dd371e7dc00"} Jun 03 23:34:24.041179 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.041158 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" event={"ID":"d655140d-3d9e-4385-8ff1-6b698b7a13f4","Type":"ContainerStarted","Data":"3b704217f0341ba9324510cb676ae114f1cac72a97902a1e7ef7c75731dde7d5"} Jun 03 23:34:24.041283 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.041201 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" event={"ID":"d655140d-3d9e-4385-8ff1-6b698b7a13f4","Type":"ContainerStarted","Data":"c4f99241ee7d138633f68056d498343cd56b0110843c20f159771a717405626f"} Jun 03 23:34:24.043511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.043063 2566 generic.go:356] "Generic (PLEG): container finished" podID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerID="aa432ed1098720c9e55e33e765a07267117427801d56f11a736b19dde50eaec4" exitCode=0 Jun 03 23:34:24.043511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.043160 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" event={"ID":"41b9bf6f-c647-4174-bc16-2af5c4f17e67","Type":"ContainerDied","Data":"aa432ed1098720c9e55e33e765a07267117427801d56f11a736b19dde50eaec4"} Jun 03 23:34:24.043511 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.043197 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" event={"ID":"41b9bf6f-c647-4174-bc16-2af5c4f17e67","Type":"ContainerStarted","Data":"b84010b20fdc724edd16f5ac7bc2faea2aab865a6cc40f4feb94e27c32081ae9"} Jun 03 23:34:24.045570 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.045548 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s"] Jun 03 23:34:24.049423 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.049408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.061442 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.061417 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s"] Jun 03 23:34:24.135702 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.135670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.135797 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.135754 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94hfm\" (UniqueName: \"kubernetes.io/projected/2392ccd6-d08d-449a-9826-5c56632770b9-kube-api-access-94hfm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.135871 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.135824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.237187 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.237099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.237187 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.237161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94hfm\" (UniqueName: \"kubernetes.io/projected/2392ccd6-d08d-449a-9826-5c56632770b9-kube-api-access-94hfm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.237688 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.237219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.237735 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.237683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.237735 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.237699 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.247573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.247542 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94hfm\" (UniqueName: \"kubernetes.io/projected/2392ccd6-d08d-449a-9826-5c56632770b9-kube-api-access-94hfm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.398454 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.398421 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:24.535156 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:24.535127 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s"] Jun 03 23:34:24.537066 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:34:24.537036 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2392ccd6_d08d_449a_9826_5c56632770b9.slice/crio-5c7778b14057cc521e311c237aee1356e0ec1c8e483440d70004e641b5bbd0ed WatchSource:0}: Error finding container 5c7778b14057cc521e311c237aee1356e0ec1c8e483440d70004e641b5bbd0ed: Status 404 returned error can't find the container with id 5c7778b14057cc521e311c237aee1356e0ec1c8e483440d70004e641b5bbd0ed Jun 03 23:34:25.049734 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.049703 2566 generic.go:356] "Generic (PLEG): container finished" podID="2392ccd6-d08d-449a-9826-5c56632770b9" containerID="f0cf6442fc6cb5e37ac448339cd66dce4b8e345f0a340dfd774ad5fe18cb6a53" exitCode=0 Jun 03 23:34:25.049871 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.049787 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" event={"ID":"2392ccd6-d08d-449a-9826-5c56632770b9","Type":"ContainerDied","Data":"f0cf6442fc6cb5e37ac448339cd66dce4b8e345f0a340dfd774ad5fe18cb6a53"} Jun 03 23:34:25.049871 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.049835 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" event={"ID":"2392ccd6-d08d-449a-9826-5c56632770b9","Type":"ContainerStarted","Data":"5c7778b14057cc521e311c237aee1356e0ec1c8e483440d70004e641b5bbd0ed"} Jun 03 23:34:25.051727 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.051703 2566 generic.go:356] "Generic (PLEG): container finished" podID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerID="3b704217f0341ba9324510cb676ae114f1cac72a97902a1e7ef7c75731dde7d5" exitCode=0 Jun 03 23:34:25.051835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.051728 2566 generic.go:356] "Generic (PLEG): container finished" podID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerID="0788f4863d3a891b54083c017fa3ab00ab80e8c20bd73629589287f9fb5463e9" exitCode=0 Jun 03 23:34:25.051835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.051788 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" event={"ID":"d655140d-3d9e-4385-8ff1-6b698b7a13f4","Type":"ContainerDied","Data":"3b704217f0341ba9324510cb676ae114f1cac72a97902a1e7ef7c75731dde7d5"} Jun 03 23:34:25.051835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.051833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" event={"ID":"d655140d-3d9e-4385-8ff1-6b698b7a13f4","Type":"ContainerDied","Data":"0788f4863d3a891b54083c017fa3ab00ab80e8c20bd73629589287f9fb5463e9"} Jun 03 23:34:25.053784 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.053764 2566 generic.go:356] "Generic (PLEG): container finished" podID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerID="f32d9dfd8580da30809e77bbd738d823f904aa365a7c11bde1e6ed4555d0d5e8" exitCode=0 Jun 03 23:34:25.053889 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.053848 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" event={"ID":"41b9bf6f-c647-4174-bc16-2af5c4f17e67","Type":"ContainerDied","Data":"f32d9dfd8580da30809e77bbd738d823f904aa365a7c11bde1e6ed4555d0d5e8"} Jun 03 23:34:25.056291 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.056265 2566 generic.go:356] "Generic (PLEG): container finished" podID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerID="1eeceee61ae8c77b313685448c541ad4242a44ee339529480fc090b28a75be8c" exitCode=0 Jun 03 23:34:25.056391 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:25.056303 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" event={"ID":"a3130bc2-b082-4009-9af3-aab06f4c9f21","Type":"ContainerDied","Data":"1eeceee61ae8c77b313685448c541ad4242a44ee339529480fc090b28a75be8c"} Jun 03 23:34:26.066651 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.066611 2566 generic.go:356] "Generic (PLEG): container finished" podID="2392ccd6-d08d-449a-9826-5c56632770b9" containerID="ce13d1617d9a3f36770b2790ba5794c9d8db9f6457b6495aef1f09135c9678e4" exitCode=0 Jun 03 23:34:26.067116 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.066659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" event={"ID":"2392ccd6-d08d-449a-9826-5c56632770b9","Type":"ContainerDied","Data":"ce13d1617d9a3f36770b2790ba5794c9d8db9f6457b6495aef1f09135c9678e4"} Jun 03 23:34:26.068958 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.068940 2566 generic.go:356] "Generic (PLEG): container finished" podID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerID="a75e280dd04b47524e211955881730fadb4d6aada27ad9eee9e207a46af2d29d" exitCode=0 Jun 03 23:34:26.069052 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.069023 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" event={"ID":"d655140d-3d9e-4385-8ff1-6b698b7a13f4","Type":"ContainerDied","Data":"a75e280dd04b47524e211955881730fadb4d6aada27ad9eee9e207a46af2d29d"} Jun 03 23:34:26.070869 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.070846 2566 generic.go:356] "Generic (PLEG): container finished" podID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerID="1956c494baf5c35d392d6790a9920bc47e5863f383ff2cabe670193965765920" exitCode=0 Jun 03 23:34:26.070970 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.070919 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" event={"ID":"41b9bf6f-c647-4174-bc16-2af5c4f17e67","Type":"ContainerDied","Data":"1956c494baf5c35d392d6790a9920bc47e5863f383ff2cabe670193965765920"} Jun 03 23:34:26.200872 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.200850 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:26.356007 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.355979 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4rpz\" (UniqueName: \"kubernetes.io/projected/a3130bc2-b082-4009-9af3-aab06f4c9f21-kube-api-access-g4rpz\") pod \"a3130bc2-b082-4009-9af3-aab06f4c9f21\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " Jun 03 23:34:26.356146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.356012 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-util\") pod \"a3130bc2-b082-4009-9af3-aab06f4c9f21\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " Jun 03 23:34:26.356146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.356062 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-bundle\") pod \"a3130bc2-b082-4009-9af3-aab06f4c9f21\" (UID: \"a3130bc2-b082-4009-9af3-aab06f4c9f21\") " Jun 03 23:34:26.356573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.356548 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-bundle" (OuterVolumeSpecName: "bundle") pod "a3130bc2-b082-4009-9af3-aab06f4c9f21" (UID: "a3130bc2-b082-4009-9af3-aab06f4c9f21"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:26.358357 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.358336 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3130bc2-b082-4009-9af3-aab06f4c9f21-kube-api-access-g4rpz" (OuterVolumeSpecName: "kube-api-access-g4rpz") pod "a3130bc2-b082-4009-9af3-aab06f4c9f21" (UID: "a3130bc2-b082-4009-9af3-aab06f4c9f21"). InnerVolumeSpecName "kube-api-access-g4rpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:26.363991 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.363967 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-util" (OuterVolumeSpecName: "util") pod "a3130bc2-b082-4009-9af3-aab06f4c9f21" (UID: "a3130bc2-b082-4009-9af3-aab06f4c9f21"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:26.456992 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.456966 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4rpz\" (UniqueName: \"kubernetes.io/projected/a3130bc2-b082-4009-9af3-aab06f4c9f21-kube-api-access-g4rpz\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:26.456992 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.456991 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:26.457130 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:26.457005 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a3130bc2-b082-4009-9af3-aab06f4c9f21-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:27.077150 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.077118 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" Jun 03 23:34:27.077150 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.077129 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt" event={"ID":"a3130bc2-b082-4009-9af3-aab06f4c9f21","Type":"ContainerDied","Data":"4fcc86e011516db3f401f2eb7f8a66601e4eee6a82d865ae52cc3c973deed10f"} Jun 03 23:34:27.077654 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.077174 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fcc86e011516db3f401f2eb7f8a66601e4eee6a82d865ae52cc3c973deed10f" Jun 03 23:34:27.079426 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.079396 2566 generic.go:356] "Generic (PLEG): container finished" podID="2392ccd6-d08d-449a-9826-5c56632770b9" containerID="85e34a00f43cab5f136dc9adf7ba6c0e42101e1f50302032c1cf2101ce48ac78" exitCode=0 Jun 03 23:34:27.079667 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.079466 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" event={"ID":"2392ccd6-d08d-449a-9826-5c56632770b9","Type":"ContainerDied","Data":"85e34a00f43cab5f136dc9adf7ba6c0e42101e1f50302032c1cf2101ce48ac78"} Jun 03 23:34:27.220313 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.220265 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:27.237040 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.237018 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:27.363622 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.363547 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-bundle\") pod \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " Jun 03 23:34:27.363622 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.363589 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-util\") pod \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " Jun 03 23:34:27.363808 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.363634 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-util\") pod \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " Jun 03 23:34:27.363808 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.363691 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkj9t\" (UniqueName: \"kubernetes.io/projected/d655140d-3d9e-4385-8ff1-6b698b7a13f4-kube-api-access-tkj9t\") pod \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " Jun 03 23:34:27.363808 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.363721 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zszvz\" (UniqueName: \"kubernetes.io/projected/41b9bf6f-c647-4174-bc16-2af5c4f17e67-kube-api-access-zszvz\") pod \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\" (UID: \"41b9bf6f-c647-4174-bc16-2af5c4f17e67\") " Jun 03 23:34:27.363808 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.363776 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-bundle\") pod \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\" (UID: \"d655140d-3d9e-4385-8ff1-6b698b7a13f4\") " Jun 03 23:34:27.364167 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.364130 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-bundle" (OuterVolumeSpecName: "bundle") pod "41b9bf6f-c647-4174-bc16-2af5c4f17e67" (UID: "41b9bf6f-c647-4174-bc16-2af5c4f17e67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:27.364513 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.364487 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-bundle" (OuterVolumeSpecName: "bundle") pod "d655140d-3d9e-4385-8ff1-6b698b7a13f4" (UID: "d655140d-3d9e-4385-8ff1-6b698b7a13f4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:27.366136 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.366116 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b9bf6f-c647-4174-bc16-2af5c4f17e67-kube-api-access-zszvz" (OuterVolumeSpecName: "kube-api-access-zszvz") pod "41b9bf6f-c647-4174-bc16-2af5c4f17e67" (UID: "41b9bf6f-c647-4174-bc16-2af5c4f17e67"). InnerVolumeSpecName "kube-api-access-zszvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:27.366481 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.366454 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d655140d-3d9e-4385-8ff1-6b698b7a13f4-kube-api-access-tkj9t" (OuterVolumeSpecName: "kube-api-access-tkj9t") pod "d655140d-3d9e-4385-8ff1-6b698b7a13f4" (UID: "d655140d-3d9e-4385-8ff1-6b698b7a13f4"). InnerVolumeSpecName "kube-api-access-tkj9t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:27.369735 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.369708 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-util" (OuterVolumeSpecName: "util") pod "d655140d-3d9e-4385-8ff1-6b698b7a13f4" (UID: "d655140d-3d9e-4385-8ff1-6b698b7a13f4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:27.369828 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.369731 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-util" (OuterVolumeSpecName: "util") pod "41b9bf6f-c647-4174-bc16-2af5c4f17e67" (UID: "41b9bf6f-c647-4174-bc16-2af5c4f17e67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:27.464572 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.464529 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:27.464572 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.464567 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:27.464572 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.464579 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/41b9bf6f-c647-4174-bc16-2af5c4f17e67-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:27.464743 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.464591 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkj9t\" (UniqueName: \"kubernetes.io/projected/d655140d-3d9e-4385-8ff1-6b698b7a13f4-kube-api-access-tkj9t\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:27.464743 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.464605 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zszvz\" (UniqueName: \"kubernetes.io/projected/41b9bf6f-c647-4174-bc16-2af5c4f17e67-kube-api-access-zszvz\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:27.464743 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:27.464617 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d655140d-3d9e-4385-8ff1-6b698b7a13f4-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:28.086973 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.086945 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" Jun 03 23:34:28.087387 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.086976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv" event={"ID":"d655140d-3d9e-4385-8ff1-6b698b7a13f4","Type":"ContainerDied","Data":"c4f99241ee7d138633f68056d498343cd56b0110843c20f159771a717405626f"} Jun 03 23:34:28.087387 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.087024 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4f99241ee7d138633f68056d498343cd56b0110843c20f159771a717405626f" Jun 03 23:34:28.088994 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.088971 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" Jun 03 23:34:28.089104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.088997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n" event={"ID":"41b9bf6f-c647-4174-bc16-2af5c4f17e67","Type":"ContainerDied","Data":"b84010b20fdc724edd16f5ac7bc2faea2aab865a6cc40f4feb94e27c32081ae9"} Jun 03 23:34:28.089104 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.089031 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b84010b20fdc724edd16f5ac7bc2faea2aab865a6cc40f4feb94e27c32081ae9" Jun 03 23:34:28.222030 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.222001 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:28.373299 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.373220 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-bundle\") pod \"2392ccd6-d08d-449a-9826-5c56632770b9\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " Jun 03 23:34:28.373299 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.373269 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-94hfm\" (UniqueName: \"kubernetes.io/projected/2392ccd6-d08d-449a-9826-5c56632770b9-kube-api-access-94hfm\") pod \"2392ccd6-d08d-449a-9826-5c56632770b9\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " Jun 03 23:34:28.373498 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.373307 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-util\") pod \"2392ccd6-d08d-449a-9826-5c56632770b9\" (UID: \"2392ccd6-d08d-449a-9826-5c56632770b9\") " Jun 03 23:34:28.373801 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.373769 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-bundle" (OuterVolumeSpecName: "bundle") pod "2392ccd6-d08d-449a-9826-5c56632770b9" (UID: "2392ccd6-d08d-449a-9826-5c56632770b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:28.375518 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.375499 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2392ccd6-d08d-449a-9826-5c56632770b9-kube-api-access-94hfm" (OuterVolumeSpecName: "kube-api-access-94hfm") pod "2392ccd6-d08d-449a-9826-5c56632770b9" (UID: "2392ccd6-d08d-449a-9826-5c56632770b9"). InnerVolumeSpecName "kube-api-access-94hfm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:34:28.380984 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.380960 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-util" (OuterVolumeSpecName: "util") pod "2392ccd6-d08d-449a-9826-5c56632770b9" (UID: "2392ccd6-d08d-449a-9826-5c56632770b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:34:28.474820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.474788 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:28.474820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.474816 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2392ccd6-d08d-449a-9826-5c56632770b9-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:28.474820 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:28.474825 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-94hfm\" (UniqueName: \"kubernetes.io/projected/2392ccd6-d08d-449a-9826-5c56632770b9-kube-api-access-94hfm\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:34:29.096086 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:29.096047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" event={"ID":"2392ccd6-d08d-449a-9826-5c56632770b9","Type":"ContainerDied","Data":"5c7778b14057cc521e311c237aee1356e0ec1c8e483440d70004e641b5bbd0ed"} Jun 03 23:34:29.096086 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:29.096079 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s" Jun 03 23:34:29.096666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:29.096104 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c7778b14057cc521e311c237aee1356e0ec1c8e483440d70004e641b5bbd0ed" Jun 03 23:34:34.946902 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:34.946865 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7549fbfb-wfmb9"] Jun 03 23:34:38.788634 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788598 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw"] Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788929 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="pull" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788940 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="pull" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788952 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="extract" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788958 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="extract" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788966 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="pull" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788972 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="pull" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788982 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="pull" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788987 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="pull" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.788996 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="util" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789001 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="util" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789006 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="util" Jun 03 23:34:38.789009 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789011 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="util" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789017 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="util" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789021 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="util" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789032 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="util" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789038 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="util" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789043 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="pull" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789047 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="pull" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789053 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789058 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789065 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789071 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789078 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789082 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789133 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3130bc2-b082-4009-9af3-aab06f4c9f21" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789142 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d655140d-3d9e-4385-8ff1-6b698b7a13f4" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789147 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b9bf6f-c647-4174-bc16-2af5c4f17e67" containerName="extract" Jun 03 23:34:38.789427 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.789154 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="2392ccd6-d08d-449a-9826-5c56632770b9" containerName="extract" Jun 03 23:34:38.792571 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.792553 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:38.799387 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.799365 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 03 23:34:38.799736 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.799720 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fjmn4\"" Jun 03 23:34:38.802683 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.802668 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 03 23:34:38.908142 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.908106 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw"] Jun 03 23:34:38.960466 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.960433 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fce4a6e-6739-41e7-89cd-dc572cefd563-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:38.960615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:38.960484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vf5d\" (UniqueName: \"kubernetes.io/projected/8fce4a6e-6739-41e7-89cd-dc572cefd563-kube-api-access-8vf5d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:39.060933 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:39.060850 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fce4a6e-6739-41e7-89cd-dc572cefd563-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:39.060933 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:39.060901 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vf5d\" (UniqueName: \"kubernetes.io/projected/8fce4a6e-6739-41e7-89cd-dc572cefd563-kube-api-access-8vf5d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:39.061217 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:39.061195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fce4a6e-6739-41e7-89cd-dc572cefd563-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:39.078953 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:39.078930 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vf5d\" (UniqueName: \"kubernetes.io/projected/8fce4a6e-6739-41e7-89cd-dc572cefd563-kube-api-access-8vf5d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:39.102521 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:39.102498 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:39.240737 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:39.240710 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw"] Jun 03 23:34:39.242423 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:34:39.242395 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fce4a6e_6739_41e7_89cd_dc572cefd563.slice/crio-f85293051ba6c15f1b70247bcedaca71174e1549a7b0d4e0f8f8cd884a84cbeb WatchSource:0}: Error finding container f85293051ba6c15f1b70247bcedaca71174e1549a7b0d4e0f8f8cd884a84cbeb: Status 404 returned error can't find the container with id f85293051ba6c15f1b70247bcedaca71174e1549a7b0d4e0f8f8cd884a84cbeb Jun 03 23:34:40.156629 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:40.156593 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" event={"ID":"8fce4a6e-6739-41e7-89cd-dc572cefd563","Type":"ContainerStarted","Data":"f85293051ba6c15f1b70247bcedaca71174e1549a7b0d4e0f8f8cd884a84cbeb"} Jun 03 23:34:42.659381 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:42.659345 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:34:42.660002 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:42.659982 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:34:42.664514 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:42.664494 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:34:42.664813 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:42.664797 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:34:45.190136 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:45.190102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" event={"ID":"8fce4a6e-6739-41e7-89cd-dc572cefd563","Type":"ContainerStarted","Data":"6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451"} Jun 03 23:34:45.190610 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:45.190167 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:45.213374 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:45.213307 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" podStartSLOduration=2.055495692 podStartE2EDuration="7.213289166s" totalImagesPullingTime="5.157793474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:34:45.21166377 +0000 UTC m=+603.021170953" watchObservedRunningTime="2026-06-03 23:34:45.213289166 +0000 UTC m=+603.022796348" Jun 03 23:34:47.360984 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.360946 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj"] Jun 03 23:34:47.365008 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.364989 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.368506 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.368483 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tvmwh\"" Jun 03 23:34:47.368608 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.368484 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 03 23:34:47.369140 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.369122 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 03 23:34:47.394058 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.394027 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj"] Jun 03 23:34:47.436255 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.436219 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqgst\" (UniqueName: \"kubernetes.io/projected/c5517e57-1143-447f-b6ac-7159cc3f61a3-kube-api-access-fqgst\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.436433 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.436268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5517e57-1143-447f-b6ac-7159cc3f61a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.436433 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.436309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5517e57-1143-447f-b6ac-7159cc3f61a3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.537073 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.537037 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5517e57-1143-447f-b6ac-7159cc3f61a3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.537252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.537108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgst\" (UniqueName: \"kubernetes.io/projected/c5517e57-1143-447f-b6ac-7159cc3f61a3-kube-api-access-fqgst\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.537252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.537163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5517e57-1143-447f-b6ac-7159cc3f61a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.537410 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:34:47.537302 2566 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 03 23:34:47.537410 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:34:47.537384 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5517e57-1143-447f-b6ac-7159cc3f61a3-plugin-serving-cert podName:c5517e57-1143-447f-b6ac-7159cc3f61a3 nodeName:}" failed. No retries permitted until 2026-06-03 23:34:48.037363289 +0000 UTC m=+605.846870454 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c5517e57-1143-447f-b6ac-7159cc3f61a3-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-6b2sj" (UID: "c5517e57-1143-447f-b6ac-7159cc3f61a3") : secret "plugin-serving-cert" not found Jun 03 23:34:47.537851 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.537833 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c5517e57-1143-447f-b6ac-7159cc3f61a3-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:47.547718 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:47.547687 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqgst\" (UniqueName: \"kubernetes.io/projected/c5517e57-1143-447f-b6ac-7159cc3f61a3-kube-api-access-fqgst\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:48.040727 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:48.040688 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5517e57-1143-447f-b6ac-7159cc3f61a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:48.043205 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:48.043181 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c5517e57-1143-447f-b6ac-7159cc3f61a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6b2sj\" (UID: \"c5517e57-1143-447f-b6ac-7159cc3f61a3\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:48.275150 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:48.275103 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" Jun 03 23:34:48.414568 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:48.414545 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj"] Jun 03 23:34:48.416615 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:34:48.416585 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5517e57_1143_447f_b6ac_7159cc3f61a3.slice/crio-f6d37e622430f5d9744c0e876cd253b726c75e1dce90e2d98bc0c0151628da50 WatchSource:0}: Error finding container f6d37e622430f5d9744c0e876cd253b726c75e1dce90e2d98bc0c0151628da50: Status 404 returned error can't find the container with id f6d37e622430f5d9744c0e876cd253b726c75e1dce90e2d98bc0c0151628da50 Jun 03 23:34:49.214619 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:49.214577 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" event={"ID":"c5517e57-1143-447f-b6ac-7159cc3f61a3","Type":"ContainerStarted","Data":"f6d37e622430f5d9744c0e876cd253b726c75e1dce90e2d98bc0c0151628da50"} Jun 03 23:34:56.200484 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:56.200385 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:58.353561 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.353526 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw"] Jun 03 23:34:58.354034 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.353750 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" containerName="manager" containerID="cri-o://6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451" gracePeriod=2 Jun 03 23:34:58.364796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.364749 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw"] Jun 03 23:34:58.412774 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.412733 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz"] Jun 03 23:34:58.413494 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.413284 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" containerName="manager" Jun 03 23:34:58.413494 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.413304 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" containerName="manager" Jun 03 23:34:58.413655 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.413511 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" containerName="manager" Jun 03 23:34:58.418621 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.418602 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:34:58.422160 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.422138 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-csbw6\"" Jun 03 23:34:58.438938 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.438859 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz"] Jun 03 23:34:58.449023 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:34:58.448982 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:34:58.539681 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.539647 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9v6q\" (UniqueName: \"kubernetes.io/projected/9d9706c7-8c9f-4f91-a756-90318ee35385-kube-api-access-c9v6q\") pod \"limitador-operator-controller-manager-859d7b78bd-4tcrz\" (UID: \"9d9706c7-8c9f-4f91-a756-90318ee35385\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:34:58.640801 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.640706 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9v6q\" (UniqueName: \"kubernetes.io/projected/9d9706c7-8c9f-4f91-a756-90318ee35385-kube-api-access-c9v6q\") pod \"limitador-operator-controller-manager-859d7b78bd-4tcrz\" (UID: \"9d9706c7-8c9f-4f91-a756-90318ee35385\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:34:58.665356 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.665255 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9v6q\" (UniqueName: \"kubernetes.io/projected/9d9706c7-8c9f-4f91-a756-90318ee35385-kube-api-access-c9v6q\") pod \"limitador-operator-controller-manager-859d7b78bd-4tcrz\" (UID: \"9d9706c7-8c9f-4f91-a756-90318ee35385\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:34:58.742090 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:58.742050 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:34:59.967491 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:34:59.967448 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c7549fbfb-wfmb9" podUID="8d66bc1b-1725-4327-830e-da9ad6b85146" containerName="console" containerID="cri-o://1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452" gracePeriod=15 Jun 03 23:35:08.914741 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:08.914691 2566 patch_prober.go:28] interesting pod/console-6c7549fbfb-wfmb9 container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" start-of-body= Jun 03 23:35:08.915169 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:08.914772 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-6c7549fbfb-wfmb9" podUID="8d66bc1b-1725-4327-830e-da9ad6b85146" containerName="console" probeResult="failure" output="Get \"https://10.134.0.23:8443/health\": dial tcp 10.134.0.23:8443: connect: connection refused" Jun 03 23:35:10.258935 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.258908 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:35:10.271882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.271808 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz"] Jun 03 23:35:10.272640 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:35:10.272604 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9706c7_8c9f_4f91_a756_90318ee35385.slice/crio-8a3b422f6dc98da3c5c5f07e183a600dc8f98d5ceced34ebca029a1c0401d902 WatchSource:0}: Error finding container 8a3b422f6dc98da3c5c5f07e183a600dc8f98d5ceced34ebca029a1c0401d902: Status 404 returned error can't find the container with id 8a3b422f6dc98da3c5c5f07e183a600dc8f98d5ceced34ebca029a1c0401d902 Jun 03 23:35:10.275385 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.275351 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.283486 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.283450 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.346966 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.346943 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-service-ca\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.346988 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-trusted-ca-bundle\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347023 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-console-config\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347069 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fce4a6e-6739-41e7-89cd-dc572cefd563-extensions-socket-volume\") pod \"8fce4a6e-6739-41e7-89cd-dc572cefd563\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " Jun 03 23:35:10.347120 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347101 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vf5d\" (UniqueName: \"kubernetes.io/projected/8fce4a6e-6739-41e7-89cd-dc572cefd563-kube-api-access-8vf5d\") pod \"8fce4a6e-6739-41e7-89cd-dc572cefd563\" (UID: \"8fce4a6e-6739-41e7-89cd-dc572cefd563\") " Jun 03 23:35:10.347353 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347129 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fllsr\" (UniqueName: \"kubernetes.io/projected/8d66bc1b-1725-4327-830e-da9ad6b85146-kube-api-access-fllsr\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347353 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347258 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-oauth-config\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347353 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347305 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-serving-cert\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347518 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347365 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-oauth-serving-cert\") pod \"8d66bc1b-1725-4327-830e-da9ad6b85146\" (UID: \"8d66bc1b-1725-4327-830e-da9ad6b85146\") " Jun 03 23:35:10.347518 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347393 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:35:10.347518 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347489 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:35:10.347725 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347691 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8fce4a6e-6739-41e7-89cd-dc572cefd563-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8fce4a6e-6739-41e7-89cd-dc572cefd563" (UID: "8fce4a6e-6739-41e7-89cd-dc572cefd563"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:35:10.347859 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347794 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:35:10.347859 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347800 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-console-config" (OuterVolumeSpecName: "console-config") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 03 23:35:10.347990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347868 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-service-ca\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.347990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347907 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-trusted-ca-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.347990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.347922 2566 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8fce4a6e-6739-41e7-89cd-dc572cefd563-extensions-socket-volume\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.348906 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.348866 2566 generic.go:356] "Generic (PLEG): container finished" podID="8fce4a6e-6739-41e7-89cd-dc572cefd563" containerID="6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451" exitCode=0 Jun 03 23:35:10.349000 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.348967 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.349000 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.348984 2566 scope.go:117] "RemoveContainer" containerID="6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451" Jun 03 23:35:10.350002 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.349946 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:35:10.350113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350021 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 03 23:35:10.350113 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350038 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fce4a6e-6739-41e7-89cd-dc572cefd563-kube-api-access-8vf5d" (OuterVolumeSpecName: "kube-api-access-8vf5d") pod "8fce4a6e-6739-41e7-89cd-dc572cefd563" (UID: "8fce4a6e-6739-41e7-89cd-dc572cefd563"). InnerVolumeSpecName "kube-api-access-8vf5d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:10.350241 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350127 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d66bc1b-1725-4327-830e-da9ad6b85146-kube-api-access-fllsr" (OuterVolumeSpecName: "kube-api-access-fllsr") pod "8d66bc1b-1725-4327-830e-da9ad6b85146" (UID: "8d66bc1b-1725-4327-830e-da9ad6b85146"). InnerVolumeSpecName "kube-api-access-fllsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:35:10.350739 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350717 2566 generic.go:356] "Generic (PLEG): container finished" podID="8d66bc1b-1725-4327-830e-da9ad6b85146" containerID="1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452" exitCode=0 Jun 03 23:35:10.350832 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350752 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c7549fbfb-wfmb9" Jun 03 23:35:10.350832 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350748 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7549fbfb-wfmb9" event={"ID":"8d66bc1b-1725-4327-830e-da9ad6b85146","Type":"ContainerDied","Data":"1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452"} Jun 03 23:35:10.350932 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.350870 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c7549fbfb-wfmb9" event={"ID":"8d66bc1b-1725-4327-830e-da9ad6b85146","Type":"ContainerDied","Data":"c3dc94835b0bce31d341936be9d04670e58d16f2330fc4af1cc47d637f88b28b"} Jun 03 23:35:10.351870 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.351843 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.352589 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.352559 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" event={"ID":"c5517e57-1143-447f-b6ac-7159cc3f61a3","Type":"ContainerStarted","Data":"750fcfe025dbbf6d86a843a4d787f063f887b48f812feb5569661b740a19b6bf"} Jun 03 23:35:10.354021 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.353997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" event={"ID":"9d9706c7-8c9f-4f91-a756-90318ee35385","Type":"ContainerStarted","Data":"8a3b422f6dc98da3c5c5f07e183a600dc8f98d5ceced34ebca029a1c0401d902"} Jun 03 23:35:10.354434 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.354403 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.358651 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.358630 2566 scope.go:117] "RemoveContainer" containerID="6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451" Jun 03 23:35:10.358974 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.358931 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451\": container with ID starting with 6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451 not found: ID does not exist" containerID="6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451" Jun 03 23:35:10.358974 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.358956 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451"} err="failed to get container status \"6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451\": rpc error: code = NotFound desc = could not find container \"6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451\": container with ID starting with 6fddd69caf8a6d3602f85f13c6463b13dd2133293a276676bc6a17aa886c0451 not found: ID does not exist" Jun 03 23:35:10.358974 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.358970 2566 scope.go:117] "RemoveContainer" containerID="1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452" Jun 03 23:35:10.361832 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.361787 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.368965 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.368950 2566 scope.go:117] "RemoveContainer" containerID="1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452" Jun 03 23:35:10.369206 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.369188 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452\": container with ID starting with 1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452 not found: ID does not exist" containerID="1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452" Jun 03 23:35:10.369266 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.369209 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452"} err="failed to get container status \"1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452\": rpc error: code = NotFound desc = could not find container \"1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452\": container with ID starting with 1dd8ae24b4fbaabfdc4be89f61a557c8ef0b05274418bc3832931fb78d9a8452 not found: ID does not exist" Jun 03 23:35:10.382698 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.382652 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6b2sj" podStartSLOduration=1.593198576 podStartE2EDuration="23.382638977s" totalImagesPullingTime="21.789440401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:10.381508524 +0000 UTC m=+628.191015707" watchObservedRunningTime="2026-06-03 23:35:10.382638977 +0000 UTC m=+628.192146194" Jun 03 23:35:10.384137 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.384114 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.399245 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.399221 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c7549fbfb-wfmb9"] Jun 03 23:35:10.404109 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.404086 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c7549fbfb-wfmb9"] Jun 03 23:35:10.449227 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.449197 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-serving-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.449363 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.449254 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-oauth-serving-cert\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.449363 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.449297 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d66bc1b-1725-4327-830e-da9ad6b85146-console-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.449363 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.449315 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vf5d\" (UniqueName: \"kubernetes.io/projected/8fce4a6e-6739-41e7-89cd-dc572cefd563-kube-api-access-8vf5d\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.449363 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.449357 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fllsr\" (UniqueName: \"kubernetes.io/projected/8d66bc1b-1725-4327-830e-da9ad6b85146-kube-api-access-fllsr\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.449519 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.449371 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d66bc1b-1725-4327-830e-da9ad6b85146-console-oauth-config\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:35:10.662088 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:35:10.662052 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-cb4dw\" is forbidden: User \"system:node:ip-10-0-131-117.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-117.ec2.internal' and this object" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cb4dw" Jun 03 23:35:10.662360 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.662315 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d66bc1b-1725-4327-830e-da9ad6b85146" path="/var/lib/kubelet/pods/8d66bc1b-1725-4327-830e-da9ad6b85146/volumes" Jun 03 23:35:10.662766 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:10.662748 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fce4a6e-6739-41e7-89cd-dc572cefd563" path="/var/lib/kubelet/pods/8fce4a6e-6739-41e7-89cd-dc572cefd563/volumes" Jun 03 23:35:12.371397 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:12.371351 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" event={"ID":"9d9706c7-8c9f-4f91-a756-90318ee35385","Type":"ContainerStarted","Data":"a718848749329a155c156cd6b7c76000870541418d5702e6ec5952f41e52d61d"} Jun 03 23:35:12.371789 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:12.371447 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:35:12.391687 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:12.391645 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" podStartSLOduration=13.138444295 podStartE2EDuration="14.391630975s" totalImagesPullingTime="1.25318668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:34:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:12.389210367 +0000 UTC m=+630.198717549" watchObservedRunningTime="2026-06-03 23:35:12.391630975 +0000 UTC m=+630.201138156" Jun 03 23:35:23.379630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:23.379595 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4tcrz" Jun 03 23:35:46.614401 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.614371 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-xmtwv"] Jun 03 23:35:46.614762 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.614738 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d66bc1b-1725-4327-830e-da9ad6b85146" containerName="console" Jun 03 23:35:46.614762 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.614749 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d66bc1b-1725-4327-830e-da9ad6b85146" containerName="console" Jun 03 23:35:46.614837 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.614819 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d66bc1b-1725-4327-830e-da9ad6b85146" containerName="console" Jun 03 23:35:46.700371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.700340 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xmtwv"] Jun 03 23:35:46.700561 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.700448 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:35:46.704616 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.704582 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8nbw9\"" Jun 03 23:35:46.752383 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.752357 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsvn\" (UniqueName: \"kubernetes.io/projected/236ff005-0125-47c2-8c7b-1367bbd623a5-kube-api-access-klsvn\") pod \"authorino-75d556bd77-xmtwv\" (UID: \"236ff005-0125-47c2-8c7b-1367bbd623a5\") " pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:35:46.853098 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.853068 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsvn\" (UniqueName: \"kubernetes.io/projected/236ff005-0125-47c2-8c7b-1367bbd623a5-kube-api-access-klsvn\") pod \"authorino-75d556bd77-xmtwv\" (UID: \"236ff005-0125-47c2-8c7b-1367bbd623a5\") " pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:35:46.866515 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:46.866450 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsvn\" (UniqueName: \"kubernetes.io/projected/236ff005-0125-47c2-8c7b-1367bbd623a5-kube-api-access-klsvn\") pod \"authorino-75d556bd77-xmtwv\" (UID: \"236ff005-0125-47c2-8c7b-1367bbd623a5\") " pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:35:47.010510 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:47.010484 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:35:47.164304 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:47.164235 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xmtwv"] Jun 03 23:35:47.170378 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:35:47.170351 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod236ff005_0125_47c2_8c7b_1367bbd623a5.slice/crio-711f9d4a71b4f5da681be9afe65f393edef2d41b5c5ac0cd42ac46927ba025c1 WatchSource:0}: Error finding container 711f9d4a71b4f5da681be9afe65f393edef2d41b5c5ac0cd42ac46927ba025c1: Status 404 returned error can't find the container with id 711f9d4a71b4f5da681be9afe65f393edef2d41b5c5ac0cd42ac46927ba025c1 Jun 03 23:35:47.562704 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:47.562665 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xmtwv" event={"ID":"236ff005-0125-47c2-8c7b-1367bbd623a5","Type":"ContainerStarted","Data":"711f9d4a71b4f5da681be9afe65f393edef2d41b5c5ac0cd42ac46927ba025c1"} Jun 03 23:35:50.583878 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:50.583839 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xmtwv" event={"ID":"236ff005-0125-47c2-8c7b-1367bbd623a5","Type":"ContainerStarted","Data":"edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d"} Jun 03 23:35:50.610742 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:35:50.610685 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-xmtwv" podStartSLOduration=1.759271008 podStartE2EDuration="4.610668957s" totalImagesPullingTime="2.851397949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:35:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:35:50.608058835 +0000 UTC m=+668.417566010" watchObservedRunningTime="2026-06-03 23:35:50.610668957 +0000 UTC m=+668.420176138" Jun 03 23:36:17.260420 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.260382 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq"] Jun 03 23:36:17.263062 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.263046 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.266347 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.266308 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 03 23:36:17.266453 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.266346 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-m48wl\"" Jun 03 23:36:17.267481 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.267465 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 03 23:36:17.277471 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.277451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq"] Jun 03 23:36:17.401710 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.401662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrcv\" (UniqueName: \"kubernetes.io/projected/c115a905-f235-4528-8145-34579e02fca9-kube-api-access-xnrcv\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.401710 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.401716 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.401992 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.401805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.502209 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.502181 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrcv\" (UniqueName: \"kubernetes.io/projected/c115a905-f235-4528-8145-34579e02fca9-kube-api-access-xnrcv\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.502371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.502216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.502371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.502258 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.502608 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.502590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.502676 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.502613 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.518454 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.518407 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrcv\" (UniqueName: \"kubernetes.io/projected/c115a905-f235-4528-8145-34579e02fca9-kube-api-access-xnrcv\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.572715 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.572690 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:17.711995 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.711961 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq"] Jun 03 23:36:17.712915 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:36:17.712886 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc115a905_f235_4528_8145_34579e02fca9.slice/crio-fdfda1d33cdfcb89525d3dab214cd9ff99fa816847b30a16ed16583d1763c95d WatchSource:0}: Error finding container fdfda1d33cdfcb89525d3dab214cd9ff99fa816847b30a16ed16583d1763c95d: Status 404 returned error can't find the container with id fdfda1d33cdfcb89525d3dab214cd9ff99fa816847b30a16ed16583d1763c95d Jun 03 23:36:17.730950 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:17.730921 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" event={"ID":"c115a905-f235-4528-8145-34579e02fca9","Type":"ContainerStarted","Data":"fdfda1d33cdfcb89525d3dab214cd9ff99fa816847b30a16ed16583d1763c95d"} Jun 03 23:36:18.737397 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:18.737360 2566 generic.go:356] "Generic (PLEG): container finished" podID="c115a905-f235-4528-8145-34579e02fca9" containerID="63c26e777e009a66514c4a0914949187bc5d73e9df537bb4765e44d36f97e94c" exitCode=0 Jun 03 23:36:18.737835 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:18.737431 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" event={"ID":"c115a905-f235-4528-8145-34579e02fca9","Type":"ContainerDied","Data":"63c26e777e009a66514c4a0914949187bc5d73e9df537bb4765e44d36f97e94c"} Jun 03 23:36:19.743775 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:19.743745 2566 generic.go:356] "Generic (PLEG): container finished" podID="c115a905-f235-4528-8145-34579e02fca9" containerID="c8ffabd733b66188857738ad52ab2b5cc3a59b3c9bbb7edc9cdb2fe3f476580f" exitCode=0 Jun 03 23:36:19.744195 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:19.743836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" event={"ID":"c115a905-f235-4528-8145-34579e02fca9","Type":"ContainerDied","Data":"c8ffabd733b66188857738ad52ab2b5cc3a59b3c9bbb7edc9cdb2fe3f476580f"} Jun 03 23:36:20.750908 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:20.750878 2566 generic.go:356] "Generic (PLEG): container finished" podID="c115a905-f235-4528-8145-34579e02fca9" containerID="901204aaa4c9339dffdd904886719465af3965c4e1f5781b034a3aa5ec49d3f8" exitCode=0 Jun 03 23:36:20.751268 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:20.750971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" event={"ID":"c115a905-f235-4528-8145-34579e02fca9","Type":"ContainerDied","Data":"901204aaa4c9339dffdd904886719465af3965c4e1f5781b034a3aa5ec49d3f8"} Jun 03 23:36:21.886165 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:21.886140 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:22.040090 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.040012 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnrcv\" (UniqueName: \"kubernetes.io/projected/c115a905-f235-4528-8145-34579e02fca9-kube-api-access-xnrcv\") pod \"c115a905-f235-4528-8145-34579e02fca9\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " Jun 03 23:36:22.040090 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.040077 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-util\") pod \"c115a905-f235-4528-8145-34579e02fca9\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " Jun 03 23:36:22.040305 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.040110 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-bundle\") pod \"c115a905-f235-4528-8145-34579e02fca9\" (UID: \"c115a905-f235-4528-8145-34579e02fca9\") " Jun 03 23:36:22.040643 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.040611 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-bundle" (OuterVolumeSpecName: "bundle") pod "c115a905-f235-4528-8145-34579e02fca9" (UID: "c115a905-f235-4528-8145-34579e02fca9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:36:22.042310 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.042287 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c115a905-f235-4528-8145-34579e02fca9-kube-api-access-xnrcv" (OuterVolumeSpecName: "kube-api-access-xnrcv") pod "c115a905-f235-4528-8145-34579e02fca9" (UID: "c115a905-f235-4528-8145-34579e02fca9"). InnerVolumeSpecName "kube-api-access-xnrcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:36:22.046294 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.046271 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-util" (OuterVolumeSpecName: "util") pod "c115a905-f235-4528-8145-34579e02fca9" (UID: "c115a905-f235-4528-8145-34579e02fca9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 03 23:36:22.140993 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.140965 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnrcv\" (UniqueName: \"kubernetes.io/projected/c115a905-f235-4528-8145-34579e02fca9-kube-api-access-xnrcv\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:36:22.140993 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.140993 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-util\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:36:22.141146 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.141007 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c115a905-f235-4528-8145-34579e02fca9-bundle\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:36:22.762844 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.762817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" event={"ID":"c115a905-f235-4528-8145-34579e02fca9","Type":"ContainerDied","Data":"fdfda1d33cdfcb89525d3dab214cd9ff99fa816847b30a16ed16583d1763c95d"} Jun 03 23:36:22.763026 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.762862 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdfda1d33cdfcb89525d3dab214cd9ff99fa816847b30a16ed16583d1763c95d" Jun 03 23:36:22.763026 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:22.762829 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70v66qq" Jun 03 23:36:40.486905 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.486873 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487295 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="util" Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487314 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="util" Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487353 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="pull" Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487361 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="pull" Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487378 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="extract" Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487389 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="extract" Jun 03 23:36:40.487482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.487474 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c115a905-f235-4528-8145-34579e02fca9" containerName="extract" Jun 03 23:36:40.489517 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.489501 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:40.492554 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.492532 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:36:40.492688 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.492538 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-mzpm9\"" Jun 03 23:36:40.492688 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.492539 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:36:40.492688 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.492573 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:36:40.502304 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.502280 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:36:40.579037 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.578997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd98w\" (UniqueName: \"kubernetes.io/projected/8eba1e80-6281-4937-be35-0d1f6d82b0bd-kube-api-access-zd98w\") pod \"maas-keycloak-0\" (UID: \"8eba1e80-6281-4937-be35-0d1f6d82b0bd\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:40.679601 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.679563 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd98w\" (UniqueName: \"kubernetes.io/projected/8eba1e80-6281-4937-be35-0d1f6d82b0bd-kube-api-access-zd98w\") pod \"maas-keycloak-0\" (UID: \"8eba1e80-6281-4937-be35-0d1f6d82b0bd\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:40.689202 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.689177 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd98w\" (UniqueName: \"kubernetes.io/projected/8eba1e80-6281-4937-be35-0d1f6d82b0bd-kube-api-access-zd98w\") pod \"maas-keycloak-0\" (UID: \"8eba1e80-6281-4937-be35-0d1f6d82b0bd\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:40.799404 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.799313 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:40.942919 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.942894 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:36:40.944534 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:36:40.944507 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eba1e80_6281_4937_be35_0d1f6d82b0bd.slice/crio-8ef6c6a04c56a48860f8f7c100d72bf0eb2a3d9db039eafc0d37b27fbeb7a205 WatchSource:0}: Error finding container 8ef6c6a04c56a48860f8f7c100d72bf0eb2a3d9db039eafc0d37b27fbeb7a205: Status 404 returned error can't find the container with id 8ef6c6a04c56a48860f8f7c100d72bf0eb2a3d9db039eafc0d37b27fbeb7a205 Jun 03 23:36:40.945999 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:40.945984 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 03 23:36:41.872232 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:41.872189 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8eba1e80-6281-4937-be35-0d1f6d82b0bd","Type":"ContainerStarted","Data":"8ef6c6a04c56a48860f8f7c100d72bf0eb2a3d9db039eafc0d37b27fbeb7a205"} Jun 03 23:36:45.379274 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:45.379251 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:36:45.903929 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:45.903886 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8eba1e80-6281-4937-be35-0d1f6d82b0bd","Type":"ContainerStarted","Data":"1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af"} Jun 03 23:36:45.944712 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:45.944404 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.5176441760000001 podStartE2EDuration="5.944383806s" totalImagesPullingTime="4.42673963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:36:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:36:45.943042539 +0000 UTC m=+723.752549721" watchObservedRunningTime="2026-06-03 23:36:45.944383806 +0000 UTC m=+723.753890988" Jun 03 23:36:46.799592 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:46.799505 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:46.801600 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:46.801555 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:47.800080 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:47.800029 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:48.800167 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:48.800107 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:49.800024 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:49.799977 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:50.799533 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:50.799494 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:50.800634 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:50.800597 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:51.800546 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:51.800489 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:52.800094 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:52.800036 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:53.800505 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:53.800466 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:54.800505 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:54.800463 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:55.800133 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:55.800091 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:56.800379 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:56.800307 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:57.801038 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:57.800961 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.45:9000/health/started\": dial tcp 10.134.0.45:9000: connect: connection refused" Jun 03 23:36:58.936730 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:58.936690 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 23:36:58.957785 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:36:58.957739 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:37:08.943216 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:08.943180 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:37:11.723064 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:11.723029 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xmtwv"] Jun 03 23:37:11.723499 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:11.723205 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-xmtwv" podUID="236ff005-0125-47c2-8c7b-1367bbd623a5" containerName="authorino" containerID="cri-o://edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d" gracePeriod=30 Jun 03 23:37:11.973338 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:11.973264 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:37:12.082546 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.082502 2566 generic.go:356] "Generic (PLEG): container finished" podID="236ff005-0125-47c2-8c7b-1367bbd623a5" containerID="edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d" exitCode=0 Jun 03 23:37:12.082546 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.082544 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-xmtwv" Jun 03 23:37:12.082750 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.082585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xmtwv" event={"ID":"236ff005-0125-47c2-8c7b-1367bbd623a5","Type":"ContainerDied","Data":"edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d"} Jun 03 23:37:12.082750 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.082630 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-xmtwv" event={"ID":"236ff005-0125-47c2-8c7b-1367bbd623a5","Type":"ContainerDied","Data":"711f9d4a71b4f5da681be9afe65f393edef2d41b5c5ac0cd42ac46927ba025c1"} Jun 03 23:37:12.082750 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.082647 2566 scope.go:117] "RemoveContainer" containerID="edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d" Jun 03 23:37:12.083655 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.083634 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klsvn\" (UniqueName: \"kubernetes.io/projected/236ff005-0125-47c2-8c7b-1367bbd623a5-kube-api-access-klsvn\") pod \"236ff005-0125-47c2-8c7b-1367bbd623a5\" (UID: \"236ff005-0125-47c2-8c7b-1367bbd623a5\") " Jun 03 23:37:12.085864 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.085842 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/236ff005-0125-47c2-8c7b-1367bbd623a5-kube-api-access-klsvn" (OuterVolumeSpecName: "kube-api-access-klsvn") pod "236ff005-0125-47c2-8c7b-1367bbd623a5" (UID: "236ff005-0125-47c2-8c7b-1367bbd623a5"). InnerVolumeSpecName "kube-api-access-klsvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:37:12.099653 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.099632 2566 scope.go:117] "RemoveContainer" containerID="edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d" Jun 03 23:37:12.100098 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:37:12.100082 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d\": container with ID starting with edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d not found: ID does not exist" containerID="edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d" Jun 03 23:37:12.100179 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.100107 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d"} err="failed to get container status \"edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d\": rpc error: code = NotFound desc = could not find container \"edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d\": container with ID starting with edcea436905e4aeffbc47fc8208b8e8b7aa5db9ab092a75e98216e1de22a085d not found: ID does not exist" Jun 03 23:37:12.185162 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.185127 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klsvn\" (UniqueName: \"kubernetes.io/projected/236ff005-0125-47c2-8c7b-1367bbd623a5-kube-api-access-klsvn\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:37:12.411295 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.411264 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xmtwv"] Jun 03 23:37:12.420548 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.420518 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-xmtwv"] Jun 03 23:37:12.660339 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:12.660247 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="236ff005-0125-47c2-8c7b-1367bbd623a5" path="/var/lib/kubelet/pods/236ff005-0125-47c2-8c7b-1367bbd623a5/volumes" Jun 03 23:37:14.891267 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.891236 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-698b5b5c48-ghsck"] Jun 03 23:37:14.891718 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.891665 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="236ff005-0125-47c2-8c7b-1367bbd623a5" containerName="authorino" Jun 03 23:37:14.891718 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.891678 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="236ff005-0125-47c2-8c7b-1367bbd623a5" containerName="authorino" Jun 03 23:37:14.891808 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.891752 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="236ff005-0125-47c2-8c7b-1367bbd623a5" containerName="authorino" Jun 03 23:37:14.898082 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.898060 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:14.901307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.901279 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 03 23:37:14.901307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.901299 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-dtjw2\"" Jun 03 23:37:14.906822 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:14.906792 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698b5b5c48-ghsck"] Jun 03 23:37:15.006237 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.006198 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn2vv\" (UniqueName: \"kubernetes.io/projected/969dbc77-ae32-4861-839b-64c875b62ca5-kube-api-access-wn2vv\") pod \"maas-controller-698b5b5c48-ghsck\" (UID: \"969dbc77-ae32-4861-839b-64c875b62ca5\") " pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:15.047851 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.047809 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78b7b4bf79-jfxjn"] Jun 03 23:37:15.050155 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.050139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:15.061547 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.061526 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b7b4bf79-jfxjn"] Jun 03 23:37:15.107406 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.107367 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn2vv\" (UniqueName: \"kubernetes.io/projected/969dbc77-ae32-4861-839b-64c875b62ca5-kube-api-access-wn2vv\") pod \"maas-controller-698b5b5c48-ghsck\" (UID: \"969dbc77-ae32-4861-839b-64c875b62ca5\") " pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:15.117764 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.117740 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn2vv\" (UniqueName: \"kubernetes.io/projected/969dbc77-ae32-4861-839b-64c875b62ca5-kube-api-access-wn2vv\") pod \"maas-controller-698b5b5c48-ghsck\" (UID: \"969dbc77-ae32-4861-839b-64c875b62ca5\") " pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:15.208615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.208578 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpm6j\" (UniqueName: \"kubernetes.io/projected/c8a696f0-3432-4878-997a-1116ff6be674-kube-api-access-lpm6j\") pod \"maas-controller-78b7b4bf79-jfxjn\" (UID: \"c8a696f0-3432-4878-997a-1116ff6be674\") " pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:15.210497 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.210477 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:15.309979 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.309943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpm6j\" (UniqueName: \"kubernetes.io/projected/c8a696f0-3432-4878-997a-1116ff6be674-kube-api-access-lpm6j\") pod \"maas-controller-78b7b4bf79-jfxjn\" (UID: \"c8a696f0-3432-4878-997a-1116ff6be674\") " pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:15.320010 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.319983 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpm6j\" (UniqueName: \"kubernetes.io/projected/c8a696f0-3432-4878-997a-1116ff6be674-kube-api-access-lpm6j\") pod \"maas-controller-78b7b4bf79-jfxjn\" (UID: \"c8a696f0-3432-4878-997a-1116ff6be674\") " pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:15.352640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.348183 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698b5b5c48-ghsck"] Jun 03 23:37:15.360832 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.360811 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:15.495734 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:15.495705 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78b7b4bf79-jfxjn"] Jun 03 23:37:15.497538 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:37:15.497511 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a696f0_3432_4878_997a_1116ff6be674.slice/crio-3bb3b9cdf88f1af64d72b173fba69cc5fc0cc7d325068d0a787390258e9b6097 WatchSource:0}: Error finding container 3bb3b9cdf88f1af64d72b173fba69cc5fc0cc7d325068d0a787390258e9b6097: Status 404 returned error can't find the container with id 3bb3b9cdf88f1af64d72b173fba69cc5fc0cc7d325068d0a787390258e9b6097 Jun 03 23:37:16.110236 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:16.110183 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" event={"ID":"c8a696f0-3432-4878-997a-1116ff6be674","Type":"ContainerStarted","Data":"3bb3b9cdf88f1af64d72b173fba69cc5fc0cc7d325068d0a787390258e9b6097"} Jun 03 23:37:16.111700 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:16.111667 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698b5b5c48-ghsck" event={"ID":"969dbc77-ae32-4861-839b-64c875b62ca5","Type":"ContainerStarted","Data":"88d511a8a00d82daa532b755a1c75add27aa1a8b2ca59c630839dea0e9f93986"} Jun 03 23:37:18.125103 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:18.125072 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" event={"ID":"c8a696f0-3432-4878-997a-1116ff6be674","Type":"ContainerStarted","Data":"5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f"} Jun 03 23:37:18.125582 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:18.125181 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:18.126726 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:18.126699 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698b5b5c48-ghsck" event={"ID":"969dbc77-ae32-4861-839b-64c875b62ca5","Type":"ContainerStarted","Data":"c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714"} Jun 03 23:37:18.126841 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:18.126750 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:18.151944 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:18.151902 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" podStartSLOduration=0.718537466 podStartE2EDuration="3.151888547s" totalImagesPullingTime="2.433351081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:18.151180584 +0000 UTC m=+755.960687765" watchObservedRunningTime="2026-06-03 23:37:18.151888547 +0000 UTC m=+755.961395736" Jun 03 23:37:18.188655 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:18.188547 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-698b5b5c48-ghsck" podStartSLOduration=1.6188942370000001 podStartE2EDuration="4.188532678s" totalImagesPullingTime="2.569638441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:18.184070228 +0000 UTC m=+755.993577408" watchObservedRunningTime="2026-06-03 23:37:18.188532678 +0000 UTC m=+755.998039858" Jun 03 23:37:29.138196 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.138166 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:29.138726 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.138334 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:37:29.200979 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.200948 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698b5b5c48-ghsck"] Jun 03 23:37:29.201189 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.201137 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-698b5b5c48-ghsck" podUID="969dbc77-ae32-4861-839b-64c875b62ca5" containerName="manager" containerID="cri-o://c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714" gracePeriod=30 Jun 03 23:37:29.445247 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.445225 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:29.516940 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.516911 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wn2vv\" (UniqueName: \"kubernetes.io/projected/969dbc77-ae32-4861-839b-64c875b62ca5-kube-api-access-wn2vv\") pod \"969dbc77-ae32-4861-839b-64c875b62ca5\" (UID: \"969dbc77-ae32-4861-839b-64c875b62ca5\") " Jun 03 23:37:29.519154 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.519121 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/969dbc77-ae32-4861-839b-64c875b62ca5-kube-api-access-wn2vv" (OuterVolumeSpecName: "kube-api-access-wn2vv") pod "969dbc77-ae32-4861-839b-64c875b62ca5" (UID: "969dbc77-ae32-4861-839b-64c875b62ca5"). InnerVolumeSpecName "kube-api-access-wn2vv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:37:29.617858 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:29.617835 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wn2vv\" (UniqueName: \"kubernetes.io/projected/969dbc77-ae32-4861-839b-64c875b62ca5-kube-api-access-wn2vv\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:37:30.193781 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.193750 2566 generic.go:356] "Generic (PLEG): container finished" podID="969dbc77-ae32-4861-839b-64c875b62ca5" containerID="c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714" exitCode=0 Jun 03 23:37:30.194252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.193792 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698b5b5c48-ghsck" Jun 03 23:37:30.194252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.193831 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698b5b5c48-ghsck" event={"ID":"969dbc77-ae32-4861-839b-64c875b62ca5","Type":"ContainerDied","Data":"c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714"} Jun 03 23:37:30.194252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.193902 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698b5b5c48-ghsck" event={"ID":"969dbc77-ae32-4861-839b-64c875b62ca5","Type":"ContainerDied","Data":"88d511a8a00d82daa532b755a1c75add27aa1a8b2ca59c630839dea0e9f93986"} Jun 03 23:37:30.194252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.193939 2566 scope.go:117] "RemoveContainer" containerID="c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714" Jun 03 23:37:30.203428 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.203244 2566 scope.go:117] "RemoveContainer" containerID="c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714" Jun 03 23:37:30.203547 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:37:30.203527 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714\": container with ID starting with c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714 not found: ID does not exist" containerID="c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714" Jun 03 23:37:30.203587 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.203555 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714"} err="failed to get container status \"c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714\": rpc error: code = NotFound desc = could not find container \"c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714\": container with ID starting with c5f1c67e49cdd106269c3e71a09edfd01f12192f08149980a1eab6590e6fb714 not found: ID does not exist" Jun 03 23:37:30.217394 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.217373 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698b5b5c48-ghsck"] Jun 03 23:37:30.219680 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.219663 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-698b5b5c48-ghsck"] Jun 03 23:37:30.659374 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:30.659339 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="969dbc77-ae32-4861-839b-64c875b62ca5" path="/var/lib/kubelet/pods/969dbc77-ae32-4861-839b-64c875b62ca5/volumes" Jun 03 23:37:48.529640 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.529601 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-66b76ff877-2bnkp"] Jun 03 23:37:48.530111 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.529986 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="969dbc77-ae32-4861-839b-64c875b62ca5" containerName="manager" Jun 03 23:37:48.530111 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.529998 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="969dbc77-ae32-4861-839b-64c875b62ca5" containerName="manager" Jun 03 23:37:48.530111 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.530084 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="969dbc77-ae32-4861-839b-64c875b62ca5" containerName="manager" Jun 03 23:37:48.596557 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.596524 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-66b76ff877-2bnkp"] Jun 03 23:37:48.596715 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.596613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.599472 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.599449 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 03 23:37:48.599631 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.599481 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-l2rxf\"" Jun 03 23:37:48.673133 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.673101 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6479c808-08ce-47ac-8c2e-f1fbc5eeb544-maas-api-tls\") pod \"maas-api-66b76ff877-2bnkp\" (UID: \"6479c808-08ce-47ac-8c2e-f1fbc5eeb544\") " pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.673281 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.673162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjmsc\" (UniqueName: \"kubernetes.io/projected/6479c808-08ce-47ac-8c2e-f1fbc5eeb544-kube-api-access-hjmsc\") pod \"maas-api-66b76ff877-2bnkp\" (UID: \"6479c808-08ce-47ac-8c2e-f1fbc5eeb544\") " pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.774468 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.774439 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjmsc\" (UniqueName: \"kubernetes.io/projected/6479c808-08ce-47ac-8c2e-f1fbc5eeb544-kube-api-access-hjmsc\") pod \"maas-api-66b76ff877-2bnkp\" (UID: \"6479c808-08ce-47ac-8c2e-f1fbc5eeb544\") " pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.774645 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.774528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6479c808-08ce-47ac-8c2e-f1fbc5eeb544-maas-api-tls\") pod \"maas-api-66b76ff877-2bnkp\" (UID: \"6479c808-08ce-47ac-8c2e-f1fbc5eeb544\") " pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.777252 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.777226 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6479c808-08ce-47ac-8c2e-f1fbc5eeb544-maas-api-tls\") pod \"maas-api-66b76ff877-2bnkp\" (UID: \"6479c808-08ce-47ac-8c2e-f1fbc5eeb544\") " pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.783707 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.783644 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjmsc\" (UniqueName: \"kubernetes.io/projected/6479c808-08ce-47ac-8c2e-f1fbc5eeb544-kube-api-access-hjmsc\") pod \"maas-api-66b76ff877-2bnkp\" (UID: \"6479c808-08ce-47ac-8c2e-f1fbc5eeb544\") " pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:48.907696 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:48.907667 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:49.003410 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.003364 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-l6f5z"] Jun 03 23:37:49.006789 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.006766 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:37:49.009577 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.009555 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5kg5t\"" Jun 03 23:37:49.009776 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.009759 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 03 23:37:49.019207 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.019123 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-l6f5z"] Jun 03 23:37:49.052720 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.052698 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-66b76ff877-2bnkp"] Jun 03 23:37:49.054434 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:37:49.054410 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6479c808_08ce_47ac_8c2e_f1fbc5eeb544.slice/crio-2a634e834aca6cb47af60f7ea4fea8e306c54a8283db612ca094bada9e92b68f WatchSource:0}: Error finding container 2a634e834aca6cb47af60f7ea4fea8e306c54a8283db612ca094bada9e92b68f: Status 404 returned error can't find the container with id 2a634e834aca6cb47af60f7ea4fea8e306c54a8283db612ca094bada9e92b68f Jun 03 23:37:49.076836 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.076809 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w6wb\" (UniqueName: \"kubernetes.io/projected/e9ff6c22-78bd-4072-9a62-822a81c570e9-kube-api-access-9w6wb\") pod \"payload-processing-7c6c859784-l6f5z\" (UID: \"e9ff6c22-78bd-4072-9a62-822a81c570e9\") " pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:37:49.177514 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.177483 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w6wb\" (UniqueName: \"kubernetes.io/projected/e9ff6c22-78bd-4072-9a62-822a81c570e9-kube-api-access-9w6wb\") pod \"payload-processing-7c6c859784-l6f5z\" (UID: \"e9ff6c22-78bd-4072-9a62-822a81c570e9\") " pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:37:49.188098 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.188071 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w6wb\" (UniqueName: \"kubernetes.io/projected/e9ff6c22-78bd-4072-9a62-822a81c570e9-kube-api-access-9w6wb\") pod \"payload-processing-7c6c859784-l6f5z\" (UID: \"e9ff6c22-78bd-4072-9a62-822a81c570e9\") " pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:37:49.300371 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.300308 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-66b76ff877-2bnkp" event={"ID":"6479c808-08ce-47ac-8c2e-f1fbc5eeb544","Type":"ContainerStarted","Data":"2a634e834aca6cb47af60f7ea4fea8e306c54a8283db612ca094bada9e92b68f"} Jun 03 23:37:49.321596 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.321529 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:37:49.452642 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:49.452618 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-l6f5z"] Jun 03 23:37:49.454034 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:37:49.454011 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ff6c22_78bd_4072_9a62_822a81c570e9.slice/crio-05f6160b33f27d62174f36c0f8357eb578d9cb1a7e8d02e808e2fe648bd9f4e3 WatchSource:0}: Error finding container 05f6160b33f27d62174f36c0f8357eb578d9cb1a7e8d02e808e2fe648bd9f4e3: Status 404 returned error can't find the container with id 05f6160b33f27d62174f36c0f8357eb578d9cb1a7e8d02e808e2fe648bd9f4e3 Jun 03 23:37:50.312479 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:50.312355 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" event={"ID":"e9ff6c22-78bd-4072-9a62-822a81c570e9","Type":"ContainerStarted","Data":"05f6160b33f27d62174f36c0f8357eb578d9cb1a7e8d02e808e2fe648bd9f4e3"} Jun 03 23:37:52.327131 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:52.327091 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-66b76ff877-2bnkp" event={"ID":"6479c808-08ce-47ac-8c2e-f1fbc5eeb544","Type":"ContainerStarted","Data":"fea692746bb43c37a946c087484b498dbd4f8085a592eaf27589ec41d6947816"} Jun 03 23:37:52.327619 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:52.327215 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:37:52.328811 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:52.328774 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" event={"ID":"e9ff6c22-78bd-4072-9a62-822a81c570e9","Type":"ContainerStarted","Data":"d87798bb03ed1122cca4054c8531b093b277f18847735224c8ae6db653722054"} Jun 03 23:37:52.328926 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:52.328840 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:37:52.360847 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:52.360799 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-66b76ff877-2bnkp" podStartSLOduration=1.745739352 podStartE2EDuration="4.360786179s" totalImagesPullingTime="2.615046827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:52.358514169 +0000 UTC m=+790.168021349" watchObservedRunningTime="2026-06-03 23:37:52.360786179 +0000 UTC m=+790.170293360" Jun 03 23:37:52.396476 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:52.396424 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" podStartSLOduration=2.131495463 podStartE2EDuration="4.396405616s" totalImagesPullingTime="2.264910153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:37:52.392843779 +0000 UTC m=+790.202350960" watchObservedRunningTime="2026-06-03 23:37:52.396405616 +0000 UTC m=+790.205912800" Jun 03 23:37:58.340644 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:37:58.340613 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-66b76ff877-2bnkp" Jun 03 23:38:00.275978 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:00.275927 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:38:00.276414 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:00.276209 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" containerID="cri-o://1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af" gracePeriod=30 Jun 03 23:38:01.827798 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:01.827774 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:01.991855 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:01.991818 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd98w\" (UniqueName: \"kubernetes.io/projected/8eba1e80-6281-4937-be35-0d1f6d82b0bd-kube-api-access-zd98w\") pod \"8eba1e80-6281-4937-be35-0d1f6d82b0bd\" (UID: \"8eba1e80-6281-4937-be35-0d1f6d82b0bd\") " Jun 03 23:38:01.994127 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:01.994091 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8eba1e80-6281-4937-be35-0d1f6d82b0bd-kube-api-access-zd98w" (OuterVolumeSpecName: "kube-api-access-zd98w") pod "8eba1e80-6281-4937-be35-0d1f6d82b0bd" (UID: "8eba1e80-6281-4937-be35-0d1f6d82b0bd"). InnerVolumeSpecName "kube-api-access-zd98w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:38:02.093278 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.093254 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd98w\" (UniqueName: \"kubernetes.io/projected/8eba1e80-6281-4937-be35-0d1f6d82b0bd-kube-api-access-zd98w\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:38:02.386049 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.385966 2566 generic.go:356] "Generic (PLEG): container finished" podID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerID="1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af" exitCode=143 Jun 03 23:38:02.386049 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.386011 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.386049 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.386025 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8eba1e80-6281-4937-be35-0d1f6d82b0bd","Type":"ContainerDied","Data":"1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af"} Jun 03 23:38:02.386271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.386064 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"8eba1e80-6281-4937-be35-0d1f6d82b0bd","Type":"ContainerDied","Data":"8ef6c6a04c56a48860f8f7c100d72bf0eb2a3d9db039eafc0d37b27fbeb7a205"} Jun 03 23:38:02.386271 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.386084 2566 scope.go:117] "RemoveContainer" containerID="1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af" Jun 03 23:38:02.396470 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.396453 2566 scope.go:117] "RemoveContainer" containerID="1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af" Jun 03 23:38:02.396717 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:38:02.396701 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af\": container with ID starting with 1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af not found: ID does not exist" containerID="1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af" Jun 03 23:38:02.396765 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.396725 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af"} err="failed to get container status \"1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af\": rpc error: code = NotFound desc = could not find container \"1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af\": container with ID starting with 1abfce8040b97fdfb4edbbf5e741cb5d8f00f53dfd19aafd399d80c5a9b307af not found: ID does not exist" Jun 03 23:38:02.409233 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.409206 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:38:02.415761 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.415734 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:38:02.440242 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.440216 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:38:02.440716 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.440698 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" Jun 03 23:38:02.440768 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.440718 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" Jun 03 23:38:02.440812 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.440790 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" containerName="keycloak" Jun 03 23:38:02.445168 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.445151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.448240 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.448218 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 03 23:38:02.448240 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.448232 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 03 23:38:02.448426 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.448234 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 03 23:38:02.448426 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.448218 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 03 23:38:02.448426 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.448294 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-mzpm9\"" Jun 03 23:38:02.452735 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.452713 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:38:02.597083 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.597049 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4db9d5c7-ef73-43b9-ad76-a5adb0aea97f-test-realms\") pod \"maas-keycloak-0\" (UID: \"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.597250 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.597100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm6tw\" (UniqueName: \"kubernetes.io/projected/4db9d5c7-ef73-43b9-ad76-a5adb0aea97f-kube-api-access-bm6tw\") pod \"maas-keycloak-0\" (UID: \"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.660183 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.660103 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8eba1e80-6281-4937-be35-0d1f6d82b0bd" path="/var/lib/kubelet/pods/8eba1e80-6281-4937-be35-0d1f6d82b0bd/volumes" Jun 03 23:38:02.697751 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.697724 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4db9d5c7-ef73-43b9-ad76-a5adb0aea97f-test-realms\") pod \"maas-keycloak-0\" (UID: \"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.697871 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.697767 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm6tw\" (UniqueName: \"kubernetes.io/projected/4db9d5c7-ef73-43b9-ad76-a5adb0aea97f-kube-api-access-bm6tw\") pod \"maas-keycloak-0\" (UID: \"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.698419 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.698400 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/4db9d5c7-ef73-43b9-ad76-a5adb0aea97f-test-realms\") pod \"maas-keycloak-0\" (UID: \"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.706829 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.706803 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm6tw\" (UniqueName: \"kubernetes.io/projected/4db9d5c7-ef73-43b9-ad76-a5adb0aea97f-kube-api-access-bm6tw\") pod \"maas-keycloak-0\" (UID: \"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f\") " pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.756651 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.756613 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:02.897129 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:02.897105 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 03 23:38:02.901299 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:38:02.901186 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4db9d5c7_ef73_43b9_ad76_a5adb0aea97f.slice/crio-705b3e97eb8cc8f51da6c1b03b8554f8039c0749c438cb761c196bbb1cb3765f WatchSource:0}: Error finding container 705b3e97eb8cc8f51da6c1b03b8554f8039c0749c438cb761c196bbb1cb3765f: Status 404 returned error can't find the container with id 705b3e97eb8cc8f51da6c1b03b8554f8039c0749c438cb761c196bbb1cb3765f Jun 03 23:38:03.337735 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:03.337712 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-l6f5z" Jun 03 23:38:03.394638 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:03.394604 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f","Type":"ContainerStarted","Data":"7fbe8ce6226bc765a0cb577b9e44ae1d81f433be6d7fe745217f8f6b8728a15a"} Jun 03 23:38:03.394804 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:03.394657 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"4db9d5c7-ef73-43b9-ad76-a5adb0aea97f","Type":"ContainerStarted","Data":"705b3e97eb8cc8f51da6c1b03b8554f8039c0749c438cb761c196bbb1cb3765f"} Jun 03 23:38:03.416597 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:03.416544 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.070383254 podStartE2EDuration="1.416525318s" totalImagesPullingTime="346.142064ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:38:03.413475511 +0000 UTC m=+801.222982717" watchObservedRunningTime="2026-06-03 23:38:03.416525318 +0000 UTC m=+801.226032498" Jun 03 23:38:03.757623 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:03.757581 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:03.759159 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:03.759124 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:04.757883 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:04.757833 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:05.757881 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:05.757821 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:06.757260 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:06.757211 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:07.757666 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:07.757601 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:08.757275 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:08.757221 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:09.757407 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:09.757358 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:10.757560 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:10.757505 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:11.757799 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:11.757738 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:12.757837 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:12.757778 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:12.758457 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:12.758091 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:13.757651 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:13.757602 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:14.757099 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:14.757051 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:15.757600 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:15.757560 2566 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.50:9000/health/started\": dial tcp 10.134.0.50:9000: connect: connection refused" Jun 03 23:38:16.875355 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:16.875279 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 03 23:38:16.889563 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:16.889503 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="4db9d5c7-ef73-43b9-ad76-a5adb0aea97f" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 03 23:38:26.881745 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:38:26.881712 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 03 23:39:14.605882 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.605845 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln"] Jun 03 23:39:14.609625 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.609605 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.613818 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.613794 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 03 23:39:14.613957 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.613795 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-v9cnz\"" Jun 03 23:39:14.613957 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.613795 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 03 23:39:14.613957 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.613835 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 03 23:39:14.618621 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.618598 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln"] Jun 03 23:39:14.636438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.636405 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.636438 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.636438 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wltlg\" (UniqueName: \"kubernetes.io/projected/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-kube-api-access-wltlg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.636630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.636479 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.636630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.636503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.636630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.636532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.636630 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.636552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737206 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737206 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737205 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737291 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737482 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wltlg\" (UniqueName: \"kubernetes.io/projected/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-kube-api-access-wltlg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737609 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737656 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737749 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737726 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.737962 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.737943 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.738401 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.738359 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.739800 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.739780 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.739947 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.739921 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.746160 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.746133 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wltlg\" (UniqueName: \"kubernetes.io/projected/c53f48eb-4ac4-4bb8-9369-8b747e95c5ea-kube-api-access-wltlg\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-6llln\" (UID: \"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:14.944399 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:14.944281 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:15.085615 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:15.085527 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln"] Jun 03 23:39:15.088004 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:39:15.087961 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53f48eb_4ac4_4bb8_9369_8b747e95c5ea.slice/crio-28ce134245e12532fdfc34b1884cb6e9e8820fc854c5a7498d9cd7d3a3229d96 WatchSource:0}: Error finding container 28ce134245e12532fdfc34b1884cb6e9e8820fc854c5a7498d9cd7d3a3229d96: Status 404 returned error can't find the container with id 28ce134245e12532fdfc34b1884cb6e9e8820fc854c5a7498d9cd7d3a3229d96 Jun 03 23:39:15.863710 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:15.863673 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" event={"ID":"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea","Type":"ContainerStarted","Data":"28ce134245e12532fdfc34b1884cb6e9e8820fc854c5a7498d9cd7d3a3229d96"} Jun 03 23:39:18.883747 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:18.883710 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" event={"ID":"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea","Type":"ContainerStarted","Data":"e43ac9b201d7fdb8ce896be475c817d5f7e0984aa1fdcc7a1609fe81676192b8"} Jun 03 23:39:19.891057 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:19.890936 2566 generic.go:356] "Generic (PLEG): container finished" podID="c53f48eb-4ac4-4bb8-9369-8b747e95c5ea" containerID="e43ac9b201d7fdb8ce896be475c817d5f7e0984aa1fdcc7a1609fe81676192b8" exitCode=0 Jun 03 23:39:19.891057 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:19.891017 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" event={"ID":"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea","Type":"ContainerDied","Data":"e43ac9b201d7fdb8ce896be475c817d5f7e0984aa1fdcc7a1609fe81676192b8"} Jun 03 23:39:21.906830 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:21.906789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" event={"ID":"c53f48eb-4ac4-4bb8-9369-8b747e95c5ea","Type":"ContainerStarted","Data":"4f19840302126a821bd35b210f652d0f2de88b80e7355d8518e6c7d60a11e047"} Jun 03 23:39:21.927990 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:21.927933 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" podStartSLOduration=2.540553925 podStartE2EDuration="7.927917117s" totalImagesPullingTime="4.150587322s" totalInitContainerRuntime="1.23677587s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:39:21.925521842 +0000 UTC m=+879.735029024" watchObservedRunningTime="2026-06-03 23:39:21.927917117 +0000 UTC m=+879.737424298" Jun 03 23:39:24.944629 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:24.944595 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:24.944999 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:24.944651 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:24.957076 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:24.957048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:25.939778 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:25.939743 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-6llln" Jun 03 23:39:42.701047 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:42.701019 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:39:42.701518 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:42.701502 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:39:42.705776 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:42.705752 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:39:42.706301 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:42.706282 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:39:50.610155 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.610122 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd"] Jun 03 23:39:50.615069 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.615049 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.618673 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.618651 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 03 23:39:50.632895 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.632870 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd"] Jun 03 23:39:50.746454 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.746418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkvll\" (UniqueName: \"kubernetes.io/projected/1e528dd6-bd03-4487-b137-b1c4cbc812d5-kube-api-access-zkvll\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.746632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.746476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e528dd6-bd03-4487-b137-b1c4cbc812d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.746632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.746572 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.746632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.746606 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.746632 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.746625 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.746803 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.746664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847369 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e528dd6-bd03-4487-b137-b1c4cbc812d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847544 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847544 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847544 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847544 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847544 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847486 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkvll\" (UniqueName: \"kubernetes.io/projected/1e528dd6-bd03-4487-b137-b1c4cbc812d5-kube-api-access-zkvll\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847880 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847856 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.847967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.847925 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.849751 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.849715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e528dd6-bd03-4487-b137-b1c4cbc812d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.849885 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.849864 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e528dd6-bd03-4487-b137-b1c4cbc812d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.855919 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.855896 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkvll\" (UniqueName: \"kubernetes.io/projected/1e528dd6-bd03-4487-b137-b1c4cbc812d5-kube-api-access-zkvll\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-znmpd\" (UID: \"1e528dd6-bd03-4487-b137-b1c4cbc812d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:50.926018 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:50.925937 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:39:51.070600 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:51.070567 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd"] Jun 03 23:39:51.072636 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:39:51.072606 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e528dd6_bd03_4487_b137_b1c4cbc812d5.slice/crio-583c210e5dfac149b3db03f5f56b9c16a312f527be3feda13b9cb0cb97097480 WatchSource:0}: Error finding container 583c210e5dfac149b3db03f5f56b9c16a312f527be3feda13b9cb0cb97097480: Status 404 returned error can't find the container with id 583c210e5dfac149b3db03f5f56b9c16a312f527be3feda13b9cb0cb97097480 Jun 03 23:39:52.076408 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:52.076371 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" event={"ID":"1e528dd6-bd03-4487-b137-b1c4cbc812d5","Type":"ContainerStarted","Data":"92807da69207c07f93131c46bd0725716332f5d19577cdb055bad2669f617d7f"} Jun 03 23:39:52.076798 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:52.076454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" event={"ID":"1e528dd6-bd03-4487-b137-b1c4cbc812d5","Type":"ContainerStarted","Data":"583c210e5dfac149b3db03f5f56b9c16a312f527be3feda13b9cb0cb97097480"} Jun 03 23:39:57.903837 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:57.903764 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm"] Jun 03 23:39:57.911117 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:57.911094 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:57.913936 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:57.913910 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 03 23:39:57.916098 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:57.916055 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm"] Jun 03 23:39:58.014792 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.014765 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.014967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.014810 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.014967 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.014839 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dss5\" (UniqueName: \"kubernetes.io/projected/1e6de713-9732-4230-94b4-2611eb5a8364-kube-api-access-9dss5\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.015103 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.014965 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.015103 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.015001 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.015103 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.015042 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6de713-9732-4230-94b4-2611eb5a8364-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116087 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dss5\" (UniqueName: \"kubernetes.io/projected/1e6de713-9732-4230-94b4-2611eb5a8364-kube-api-access-9dss5\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116277 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6de713-9732-4230-94b4-2611eb5a8364-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116481 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116481 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116699 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116667 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.116699 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116683 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.117047 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.116723 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.118588 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.118569 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6de713-9732-4230-94b4-2611eb5a8364-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.118764 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.118747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6de713-9732-4230-94b4-2611eb5a8364-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.139163 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.139134 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dss5\" (UniqueName: \"kubernetes.io/projected/1e6de713-9732-4230-94b4-2611eb5a8364-kube-api-access-9dss5\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-lg5xm\" (UID: \"1e6de713-9732-4230-94b4-2611eb5a8364\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.222870 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.222827 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:39:58.367122 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:58.367093 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm"] Jun 03 23:39:58.368014 ip-10-0-131-117 kubenswrapper[2566]: W0603 23:39:58.367992 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6de713_9732_4230_94b4_2611eb5a8364.slice/crio-dd5e9e28bb70efca75d8b96dc88132a1a8deb0b1a29d0d421b1e4de9f9f4d43e WatchSource:0}: Error finding container dd5e9e28bb70efca75d8b96dc88132a1a8deb0b1a29d0d421b1e4de9f9f4d43e: Status 404 returned error can't find the container with id dd5e9e28bb70efca75d8b96dc88132a1a8deb0b1a29d0d421b1e4de9f9f4d43e Jun 03 23:39:59.117651 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:59.117619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" event={"ID":"1e6de713-9732-4230-94b4-2611eb5a8364","Type":"ContainerStarted","Data":"ba327bd0a70301d45538aec6a8dbafdaf925d63ac1e4adbbb7024bb966fe796f"} Jun 03 23:39:59.118082 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:39:59.117659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" event={"ID":"1e6de713-9732-4230-94b4-2611eb5a8364","Type":"ContainerStarted","Data":"dd5e9e28bb70efca75d8b96dc88132a1a8deb0b1a29d0d421b1e4de9f9f4d43e"} Jun 03 23:40:00.124713 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:00.124676 2566 generic.go:356] "Generic (PLEG): container finished" podID="1e6de713-9732-4230-94b4-2611eb5a8364" containerID="ba327bd0a70301d45538aec6a8dbafdaf925d63ac1e4adbbb7024bb966fe796f" exitCode=0 Jun 03 23:40:00.125097 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:00.124765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" event={"ID":"1e6de713-9732-4230-94b4-2611eb5a8364","Type":"ContainerDied","Data":"ba327bd0a70301d45538aec6a8dbafdaf925d63ac1e4adbbb7024bb966fe796f"} Jun 03 23:40:01.133056 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:01.133018 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" event={"ID":"1e6de713-9732-4230-94b4-2611eb5a8364","Type":"ContainerStarted","Data":"70a5177f5a54a3e370fa671edcafd0fe5ca532d889421f024ef8dcbb2761c0b1"} Jun 03 23:40:01.158642 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:01.158596 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" podStartSLOduration=2.686852197 podStartE2EDuration="4.158581145s" totalImagesPullingTime="254.874975ms" totalInitContainerRuntime="1.216853973s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:40:01.157714335 +0000 UTC m=+918.967221528" watchObservedRunningTime="2026-06-03 23:40:01.158581145 +0000 UTC m=+918.968088379" Jun 03 23:40:08.223898 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:08.223870 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:40:08.224380 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:08.223915 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:40:08.236669 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:08.236646 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:40:09.188909 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:09.188880 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-lg5xm" Jun 03 23:40:47.399779 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:47.399741 2566 generic.go:356] "Generic (PLEG): container finished" podID="1e528dd6-bd03-4487-b137-b1c4cbc812d5" containerID="92807da69207c07f93131c46bd0725716332f5d19577cdb055bad2669f617d7f" exitCode=0 Jun 03 23:40:47.400354 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:47.399817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" event={"ID":"1e528dd6-bd03-4487-b137-b1c4cbc812d5","Type":"ContainerDied","Data":"92807da69207c07f93131c46bd0725716332f5d19577cdb055bad2669f617d7f"} Jun 03 23:40:48.413712 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:48.413666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" event={"ID":"1e528dd6-bd03-4487-b137-b1c4cbc812d5","Type":"ContainerStarted","Data":"248dec14a40a62905e3747b30daecd668160ae3126f100884c9bf91680a5edc6"} Jun 03 23:40:48.433500 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:48.433450 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" podStartSLOduration=2.969014182 podStartE2EDuration="58.433436145s" totalImagesPullingTime="200.205601ms" totalInitContainerRuntime="55.264216362s" isStatefulPod=false podCreationTimestamp="2026-06-03 23:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-03 23:40:48.431842564 +0000 UTC m=+966.241349745" watchObservedRunningTime="2026-06-03 23:40:48.433436145 +0000 UTC m=+966.242943326" Jun 03 23:40:50.926133 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:50.926048 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:40:50.926634 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:50.926202 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:40:50.938737 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:50.938717 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:40:51.443258 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:40:51.443224 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-znmpd" Jun 03 23:42:25.525901 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.525859 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b7b4bf79-jfxjn"] Jun 03 23:42:25.526409 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.526110 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" podUID="c8a696f0-3432-4878-997a-1116ff6be674" containerName="manager" containerID="cri-o://5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f" gracePeriod=30 Jun 03 23:42:25.776340 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.776269 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:42:25.873046 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.873018 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpm6j\" (UniqueName: \"kubernetes.io/projected/c8a696f0-3432-4878-997a-1116ff6be674-kube-api-access-lpm6j\") pod \"c8a696f0-3432-4878-997a-1116ff6be674\" (UID: \"c8a696f0-3432-4878-997a-1116ff6be674\") " Jun 03 23:42:25.877370 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.876176 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8a696f0-3432-4878-997a-1116ff6be674-kube-api-access-lpm6j" (OuterVolumeSpecName: "kube-api-access-lpm6j") pod "c8a696f0-3432-4878-997a-1116ff6be674" (UID: "c8a696f0-3432-4878-997a-1116ff6be674"). InnerVolumeSpecName "kube-api-access-lpm6j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 03 23:42:25.974834 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.974803 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpm6j\" (UniqueName: \"kubernetes.io/projected/c8a696f0-3432-4878-997a-1116ff6be674-kube-api-access-lpm6j\") on node \"ip-10-0-131-117.ec2.internal\" DevicePath \"\"" Jun 03 23:42:25.975998 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.975963 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8a696f0-3432-4878-997a-1116ff6be674" containerID="5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f" exitCode=0 Jun 03 23:42:25.976128 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.976026 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" Jun 03 23:42:25.976128 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.976048 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" event={"ID":"c8a696f0-3432-4878-997a-1116ff6be674","Type":"ContainerDied","Data":"5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f"} Jun 03 23:42:25.976250 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.976149 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78b7b4bf79-jfxjn" event={"ID":"c8a696f0-3432-4878-997a-1116ff6be674","Type":"ContainerDied","Data":"3bb3b9cdf88f1af64d72b173fba69cc5fc0cc7d325068d0a787390258e9b6097"} Jun 03 23:42:25.976250 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.976185 2566 scope.go:117] "RemoveContainer" containerID="5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f" Jun 03 23:42:25.985830 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.985809 2566 scope.go:117] "RemoveContainer" containerID="5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f" Jun 03 23:42:25.986076 ip-10-0-131-117 kubenswrapper[2566]: E0603 23:42:25.986057 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f\": container with ID starting with 5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f not found: ID does not exist" containerID="5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f" Jun 03 23:42:25.986135 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:25.986084 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f"} err="failed to get container status \"5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f\": rpc error: code = NotFound desc = could not find container \"5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f\": container with ID starting with 5384275293d732f0d884ca7e0853c9a1657f9db8377f1245e40e940792116a7f not found: ID does not exist" Jun 03 23:42:26.003738 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:26.003711 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-78b7b4bf79-jfxjn"] Jun 03 23:42:26.012723 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:26.012705 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-78b7b4bf79-jfxjn"] Jun 03 23:42:26.659796 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:42:26.659753 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8a696f0-3432-4878-997a-1116ff6be674" path="/var/lib/kubelet/pods/c8a696f0-3432-4878-997a-1116ff6be674/volumes" Jun 03 23:44:42.742027 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:44:42.741998 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:44:42.745341 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:44:42.745306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:44:42.747060 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:44:42.747034 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:44:42.749868 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:44:42.749850 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:49:42.782355 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:49:42.782299 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:49:42.787607 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:49:42.787585 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:49:42.788536 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:49:42.788516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:49:42.793463 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:49:42.793446 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:54:42.823573 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:54:42.823543 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:54:42.828307 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:54:42.828280 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:54:42.832821 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:54:42.832803 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:54:42.837115 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:54:42.837099 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:59:42.863973 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:59:42.863938 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:59:42.869014 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:59:42.868989 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 03 23:59:42.875167 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:59:42.875147 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 03 23:59:42.886874 ip-10-0-131-117 kubenswrapper[2566]: I0603 23:59:42.886852 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 04 00:04:07.007154 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:07.007102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-66b76ff877-2bnkp_6479c808-08ce-47ac-8c2e-f1fbc5eeb544/maas-api/0.log" Jun 04 00:04:07.841870 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:07.841834 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-qz6gf_d4891b38-234b-48eb-830c-b51bb63f12d1/manager/0.log" Jun 04 00:04:07.852034 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:07.852009 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-qz6gf_d4891b38-234b-48eb-830c-b51bb63f12d1/copy-manifests/0.log" Jun 04 00:04:08.882414 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:08.882354 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s_2392ccd6-d08d-449a-9826-5c56632770b9/util/0.log" Jun 04 00:04:08.889954 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:08.889922 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s_2392ccd6-d08d-449a-9826-5c56632770b9/pull/0.log" Jun 04 00:04:08.897611 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:08.897589 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s_2392ccd6-d08d-449a-9826-5c56632770b9/extract/0.log" Jun 04 00:04:09.018532 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.018497 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt_a3130bc2-b082-4009-9af3-aab06f4c9f21/util/0.log" Jun 04 00:04:09.025189 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.025143 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt_a3130bc2-b082-4009-9af3-aab06f4c9f21/pull/0.log" Jun 04 00:04:09.032069 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.032050 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt_a3130bc2-b082-4009-9af3-aab06f4c9f21/extract/0.log" Jun 04 00:04:09.142238 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.142164 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv_d655140d-3d9e-4385-8ff1-6b698b7a13f4/util/0.log" Jun 04 00:04:09.149279 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.149258 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv_d655140d-3d9e-4385-8ff1-6b698b7a13f4/pull/0.log" Jun 04 00:04:09.156389 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.156368 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv_d655140d-3d9e-4385-8ff1-6b698b7a13f4/extract/0.log" Jun 04 00:04:09.281875 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.281842 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n_41b9bf6f-c647-4174-bc16-2af5c4f17e67/pull/0.log" Jun 04 00:04:09.292538 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.292517 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n_41b9bf6f-c647-4174-bc16-2af5c4f17e67/extract/0.log" Jun 04 00:04:09.300582 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.300561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n_41b9bf6f-c647-4174-bc16-2af5c4f17e67/util/0.log" Jun 04 00:04:09.790555 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:09.790530 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6b2sj_c5517e57-1143-447f-b6ac-7159cc3f61a3/kuadrant-console-plugin/0.log" Jun 04 00:04:10.292369 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:10.292335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4tcrz_9d9706c7-8c9f-4f91-a756-90318ee35385/manager/0.log" Jun 04 00:04:10.897276 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:10.897243 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b845bc8d9-dxl2x_b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85/kube-auth-proxy/0.log" Jun 04 00:04:11.375867 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:11.375834 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-l6f5z_e9ff6c22-78bd-4072-9a62-822a81c570e9/payload-processing/0.log" Jun 04 00:04:11.957065 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:11.957037 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6llln_c53f48eb-4ac4-4bb8-9369-8b747e95c5ea/storage-initializer/0.log" Jun 04 00:04:11.964688 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:11.964665 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-6llln_c53f48eb-4ac4-4bb8-9369-8b747e95c5ea/main/0.log" Jun 04 00:04:12.325469 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:12.325378 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-znmpd_1e528dd6-bd03-4487-b137-b1c4cbc812d5/storage-initializer/0.log" Jun 04 00:04:12.334019 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:12.333998 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-znmpd_1e528dd6-bd03-4487-b137-b1c4cbc812d5/main/0.log" Jun 04 00:04:12.453928 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:12.453893 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lg5xm_1e6de713-9732-4230-94b4-2611eb5a8364/storage-initializer/0.log" Jun 04 00:04:12.462529 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:12.462484 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-lg5xm_1e6de713-9732-4230-94b4-2611eb5a8364/main/0.log" Jun 04 00:04:19.967306 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:19.967275 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2qcrt_31e2628b-4f0f-48ae-84b4-ca683ad68476/global-pull-secret-syncer/0.log" Jun 04 00:04:20.148142 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:20.148108 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qq49n_2d7214c7-18c9-43c5-8a48-c9bd2149aa14/konnectivity-agent/0.log" Jun 04 00:04:20.249130 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:20.249039 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-117.ec2.internal_a00b464b27ecad8ecd553fc28c1d8a0a/haproxy/0.log" Jun 04 00:04:24.753470 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.753440 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s_2392ccd6-d08d-449a-9826-5c56632770b9/extract/0.log" Jun 04 00:04:24.776544 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.776518 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s_2392ccd6-d08d-449a-9826-5c56632770b9/util/0.log" Jun 04 00:04:24.797935 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.797910 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759xw72s_2392ccd6-d08d-449a-9826-5c56632770b9/pull/0.log" Jun 04 00:04:24.843760 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.843741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt_a3130bc2-b082-4009-9af3-aab06f4c9f21/extract/0.log" Jun 04 00:04:24.865148 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.865128 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt_a3130bc2-b082-4009-9af3-aab06f4c9f21/util/0.log" Jun 04 00:04:24.888555 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.888526 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0whcvt_a3130bc2-b082-4009-9af3-aab06f4c9f21/pull/0.log" Jun 04 00:04:24.919455 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.919434 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv_d655140d-3d9e-4385-8ff1-6b698b7a13f4/extract/0.log" Jun 04 00:04:24.940058 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.940037 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv_d655140d-3d9e-4385-8ff1-6b698b7a13f4/util/0.log" Jun 04 00:04:24.963901 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.963879 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed732b7gv_d655140d-3d9e-4385-8ff1-6b698b7a13f4/pull/0.log" Jun 04 00:04:24.992159 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:24.992134 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n_41b9bf6f-c647-4174-bc16-2af5c4f17e67/extract/0.log" Jun 04 00:04:25.013267 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:25.013200 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n_41b9bf6f-c647-4174-bc16-2af5c4f17e67/util/0.log" Jun 04 00:04:25.035030 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:25.035007 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wsm7n_41b9bf6f-c647-4174-bc16-2af5c4f17e67/pull/0.log" Jun 04 00:04:25.563769 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:25.563740 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6b2sj_c5517e57-1143-447f-b6ac-7159cc3f61a3/kuadrant-console-plugin/0.log" Jun 04 00:04:25.834784 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:25.834705 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4tcrz_9d9706c7-8c9f-4f91-a756-90318ee35385/manager/0.log" Jun 04 00:04:27.400512 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.400482 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/alertmanager/0.log" Jun 04 00:04:27.426965 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.426940 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/config-reloader/0.log" Jun 04 00:04:27.449593 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.449571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/kube-rbac-proxy-web/0.log" Jun 04 00:04:27.471083 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.471059 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/kube-rbac-proxy/0.log" Jun 04 00:04:27.492504 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.492481 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/kube-rbac-proxy-metric/0.log" Jun 04 00:04:27.512853 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.512833 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/prom-label-proxy/0.log" Jun 04 00:04:27.535676 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.535656 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_424607e8-7941-4b6d-ae6d-8a70f588448d/init-config-reloader/0.log" Jun 04 00:04:27.838262 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.838234 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5qwff_58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a/node-exporter/0.log" Jun 04 00:04:27.873764 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.873734 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5qwff_58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a/kube-rbac-proxy/0.log" Jun 04 00:04:27.905293 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:27.905273 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5qwff_58f8f8dd-c0f3-4275-9d1a-8608c5aa5a6a/init-textfile/0.log" Jun 04 00:04:28.119437 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.119364 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-kdlb4_14c961e8-3123-436b-bb52-ffa0ec350b34/kube-rbac-proxy-main/0.log" Jun 04 00:04:28.142283 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.142255 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-kdlb4_14c961e8-3123-436b-bb52-ffa0ec350b34/kube-rbac-proxy-self/0.log" Jun 04 00:04:28.167620 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.167593 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-kdlb4_14c961e8-3123-436b-bb52-ffa0ec350b34/openshift-state-metrics/0.log" Jun 04 00:04:28.380298 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.380200 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-55trx_95f28a93-9389-49d3-9ad2-3a0bafb69f8b/prometheus-operator/0.log" Jun 04 00:04:28.401768 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.401741 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-55trx_95f28a93-9389-49d3-9ad2-3a0bafb69f8b/kube-rbac-proxy/0.log" Jun 04 00:04:28.555718 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.555690 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5d6b5c5d-l5h45_97bd76fd-c5da-4423-9530-c7baadcd664f/thanos-query/0.log" Jun 04 00:04:28.582510 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.582482 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5d6b5c5d-l5h45_97bd76fd-c5da-4423-9530-c7baadcd664f/kube-rbac-proxy-web/0.log" Jun 04 00:04:28.603698 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.603674 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5d6b5c5d-l5h45_97bd76fd-c5da-4423-9530-c7baadcd664f/kube-rbac-proxy/0.log" Jun 04 00:04:28.630452 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.630386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5d6b5c5d-l5h45_97bd76fd-c5da-4423-9530-c7baadcd664f/prom-label-proxy/0.log" Jun 04 00:04:28.654804 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.654769 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5d6b5c5d-l5h45_97bd76fd-c5da-4423-9530-c7baadcd664f/kube-rbac-proxy-rules/0.log" Jun 04 00:04:28.678505 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:28.678485 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c5d6b5c5d-l5h45_97bd76fd-c5da-4423-9530-c7baadcd664f/kube-rbac-proxy-metrics/0.log" Jun 04 00:04:29.884084 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:29.884057 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-68d6b54856-6ltqs_8d207115-2859-4ca8-895b-50e9c6d01ab9/networking-console-plugin/0.log" Jun 04 00:04:30.582374 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:30.582347 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 04 00:04:30.589964 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:30.589936 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/2.log" Jun 04 00:04:31.224187 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.224157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-56b467f5ff-4rh2l_e70240a6-1818-46e1-b92e-d078d7f15997/download-server/0.log" Jun 04 00:04:31.653150 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.653070 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v"] Jun 04 00:04:31.653510 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.653496 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8a696f0-3432-4878-997a-1116ff6be674" containerName="manager" Jun 04 00:04:31.653560 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.653513 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8a696f0-3432-4878-997a-1116ff6be674" containerName="manager" Jun 04 00:04:31.653595 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.653576 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8a696f0-3432-4878-997a-1116ff6be674" containerName="manager" Jun 04 00:04:31.656692 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.656676 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.659660 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.659638 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fc9xm\"/\"kube-root-ca.crt\"" Jun 04 00:04:31.659787 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.659638 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fc9xm\"/\"openshift-service-ca.crt\"" Jun 04 00:04:31.660994 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.660968 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fc9xm\"/\"default-dockercfg-p65gb\"" Jun 04 00:04:31.664155 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.664130 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v"] Jun 04 00:04:31.790277 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.790247 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-lib-modules\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.790450 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.790291 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-proc\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.790450 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.790366 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-sys\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.790450 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.790409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptwls\" (UniqueName: \"kubernetes.io/projected/86601c2f-4330-4908-80ea-cdc026c67d37-kube-api-access-ptwls\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.790620 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.790505 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-podres\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891217 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-podres\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-lib-modules\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891272 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-proc\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-sys\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptwls\" (UniqueName: \"kubernetes.io/projected/86601c2f-4330-4908-80ea-cdc026c67d37-kube-api-access-ptwls\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891399 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-podres\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891410 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-sys\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891434 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891410 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-proc\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.891778 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.891435 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/86601c2f-4330-4908-80ea-cdc026c67d37-lib-modules\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.899408 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.899389 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptwls\" (UniqueName: \"kubernetes.io/projected/86601c2f-4330-4908-80ea-cdc026c67d37-kube-api-access-ptwls\") pod \"perf-node-gather-daemonset-7f26v\" (UID: \"86601c2f-4330-4908-80ea-cdc026c67d37\") " pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:31.968471 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:31.968439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:32.102582 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:32.102553 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v"] Jun 04 00:04:32.104027 ip-10-0-131-117 kubenswrapper[2566]: W0604 00:04:32.103983 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod86601c2f_4330_4908_80ea_cdc026c67d37.slice/crio-56a20ad81651295d2dab5bd66b560de36040165088379345fe2db4318deba4e7 WatchSource:0}: Error finding container 56a20ad81651295d2dab5bd66b560de36040165088379345fe2db4318deba4e7: Status 404 returned error can't find the container with id 56a20ad81651295d2dab5bd66b560de36040165088379345fe2db4318deba4e7 Jun 04 00:04:32.566955 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:32.566920 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" event={"ID":"86601c2f-4330-4908-80ea-cdc026c67d37","Type":"ContainerStarted","Data":"b09d4cefe94043cf678b671705ecd5ac8d8f2ccc27260aeae6bc754919c9f97c"} Jun 04 00:04:32.567368 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:32.566971 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" event={"ID":"86601c2f-4330-4908-80ea-cdc026c67d37","Type":"ContainerStarted","Data":"56a20ad81651295d2dab5bd66b560de36040165088379345fe2db4318deba4e7"} Jun 04 00:04:32.567368 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:32.567021 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:32.584474 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:32.584430 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" podStartSLOduration=1.584414419 podStartE2EDuration="1.584414419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-04 00:04:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-04 00:04:32.58207431 +0000 UTC m=+2390.391581491" watchObservedRunningTime="2026-06-04 00:04:32.584414419 +0000 UTC m=+2390.393921600" Jun 04 00:04:33.080392 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:33.080356 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhvhv_79de725f-e691-444b-9cff-68ba59239f31/dns/0.log" Jun 04 00:04:33.102675 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:33.102646 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fhvhv_79de725f-e691-444b-9cff-68ba59239f31/kube-rbac-proxy/0.log" Jun 04 00:04:33.283517 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:33.283494 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qrxwn_09f479cf-da5a-486c-8a55-e1c747cca628/dns-node-resolver/0.log" Jun 04 00:04:33.891522 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:33.891469 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dm5ql_b75f0eec-6b19-4269-9880-55b6112fca1c/node-ca/0.log" Jun 04 00:04:35.091442 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:35.091408 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b845bc8d9-dxl2x_b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85/kube-auth-proxy/0.log" Jun 04 00:04:35.388775 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:35.388693 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-l6f5z_e9ff6c22-78bd-4072-9a62-822a81c570e9/payload-processing/0.log" Jun 04 00:04:36.069514 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:36.069481 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mt7pc_ec75febd-1f67-4db2-82bc-4a2a4152d84a/serve-healthcheck-canary/0.log" Jun 04 00:04:36.749818 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:36.749785 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mxw5_32741757-240b-438e-b106-8667d29968be/kube-rbac-proxy/0.log" Jun 04 00:04:36.771705 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:36.771678 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mxw5_32741757-240b-438e-b106-8667d29968be/exporter/0.log" Jun 04 00:04:36.800008 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:36.799979 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mxw5_32741757-240b-438e-b106-8667d29968be/extractor/0.log" Jun 04 00:04:38.582861 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:38.582834 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fc9xm/perf-node-gather-daemonset-7f26v" Jun 04 00:04:39.302758 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:39.302723 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-66b76ff877-2bnkp_6479c808-08ce-47ac-8c2e-f1fbc5eeb544/maas-api/0.log" Jun 04 00:04:39.763856 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:39.763824 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-qz6gf_d4891b38-234b-48eb-830c-b51bb63f12d1/manager/0.log" Jun 04 00:04:39.782543 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:39.782515 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-684bd49f57-qz6gf_d4891b38-234b-48eb-830c-b51bb63f12d1/copy-manifests/0.log" Jun 04 00:04:41.696255 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:41.696226 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-869fd7c4f4-wvwv4_ffdd2d6e-8e7e-40af-aeae-697668e9bb21/manager/0.log" Jun 04 00:04:42.904753 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:42.904666 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 04 00:04:42.927830 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:42.909383 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 04 00:04:42.934634 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:42.934616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85bd8fd97d-jhd7b_acb82da1-1d5b-4d7c-bc8f-75a807c7774e/console-operator/1.log" Jun 04 00:04:42.939934 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:42.939909 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c86qb_919ffab0-8434-4fc2-b203-5c02d26c9ef0/ovn-acl-logging/0.log" Jun 04 00:04:44.439966 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:44.439904 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b845bc8d9-dxl2x_b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85/kube-auth-proxy/0.log" Jun 04 00:04:44.689879 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:44.689832 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-l6f5z_e9ff6c22-78bd-4072-9a62-822a81c570e9/payload-processing/0.log" Jun 04 00:04:45.982080 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:45.982045 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b845bc8d9-dxl2x_b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85/kube-auth-proxy/0.log" Jun 04 00:04:46.231278 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:46.231247 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-l6f5z_e9ff6c22-78bd-4072-9a62-822a81c570e9/payload-processing/0.log" Jun 04 00:04:47.123950 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:47.123913 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-7m8n6_38e4dc4f-72a0-4041-a06e-6cadcdc99463/migrator/0.log" Jun 04 00:04:47.145939 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:47.145914 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-7m8n6_38e4dc4f-72a0-4041-a06e-6cadcdc99463/graceful-termination/0.log" Jun 04 00:04:48.190043 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:48.190014 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5b845bc8d9-dxl2x_b0a16f03-7dcd-4ef3-8bc8-70ad11bbfc85/kube-auth-proxy/0.log" Jun 04 00:04:48.435021 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:48.434994 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-l6f5z_e9ff6c22-78bd-4072-9a62-822a81c570e9/payload-processing/0.log" Jun 04 00:04:48.843381 ip-10-0-131-117 kubenswrapper[2566]: I0604 00:04:48.843349 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7jlj9_6829bb8e-8bac-4a2f-a16c-db631bfc1dea/kube-multus/0.log"