Jun 15 03:17:53.392322 ip-10-0-128-105 systemd[1]: Starting Kubernetes Kubelet... Jun 15 03:17:53.845072 ip-10-0-128-105 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 03:17:53.845072 ip-10-0-128-105 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 03:17:53.845072 ip-10-0-128-105 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 03:17:53.845072 ip-10-0-128-105 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 03:17:53.845072 ip-10-0-128-105 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 03:17:53.846270 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.846188 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 03:17:53.850182 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850167 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:17:53.850182 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850181 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850185 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850188 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850191 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850194 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850198 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850200 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850203 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850206 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850208 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850212 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850222 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850225 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850228 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850231 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850234 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850236 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850239 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850242 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:17:53.850282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850245 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850247 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850250 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850253 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850255 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850258 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850261 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850263 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850266 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850268 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850271 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850274 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850279 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850282 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850286 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850289 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850292 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850295 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850298 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:17:53.850727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850301 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850304 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850306 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850309 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850313 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850316 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850319 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850322 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850325 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850328 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850330 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850333 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850336 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850339 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850342 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850346 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850349 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850352 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850355 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850358 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:17:53.851235 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850361 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850364 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850367 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850369 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850372 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850375 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850378 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850380 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850383 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850386 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850389 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850391 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850394 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850396 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850399 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850401 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850404 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850407 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850409 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850412 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:17:53.851727 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850414 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850417 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850419 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850422 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850424 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850426 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850430 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850433 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850436 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850438 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850441 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850444 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850446 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850449 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850451 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850454 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850456 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850459 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850461 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.850464 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:17:53.852251 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851186 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851193 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851196 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851199 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851201 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851204 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851207 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851210 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851212 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851215 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851217 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851220 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851222 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851225 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851228 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851230 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851233 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851235 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851238 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851242 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:17:53.852723 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851246 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851248 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851251 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851254 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851256 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851259 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851262 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851266 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851270 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851273 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851276 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851279 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851282 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851284 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851287 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851290 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851293 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851295 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851297 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851300 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:17:53.853226 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851303 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851305 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851308 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851310 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851312 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851315 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851317 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851320 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851322 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851326 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851330 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851334 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851337 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851341 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851344 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851347 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851350 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851353 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851356 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:17:53.853714 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851358 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851360 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851364 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851368 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851370 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851373 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851376 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851378 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851381 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851384 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851387 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851389 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851392 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851394 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851397 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851399 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851402 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851405 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851407 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:17:53.854197 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851410 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851412 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851415 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851417 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851419 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851423 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851426 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851428 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851431 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851433 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851436 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851439 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851441 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851444 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851446 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851449 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851451 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851454 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851456 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851459 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:17:53.854652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851461 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851807 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851812 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851815 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851817 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851820 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851823 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851825 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851828 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851831 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851833 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851836 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851839 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851841 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851844 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851847 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851849 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851852 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851855 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851857 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:17:53.855167 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851860 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851863 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851865 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851868 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851870 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851873 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851875 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851878 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851880 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851883 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851886 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851890 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851894 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851897 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851900 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851904 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851906 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851909 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851911 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:17:53.855651 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851914 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851917 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851919 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851922 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851925 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851944 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851947 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851950 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851953 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851955 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851958 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851961 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851966 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851969 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851972 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851974 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851979 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851982 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851985 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:17:53.856138 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851988 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851991 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851994 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.851997 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852000 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852003 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852005 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852008 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852012 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852014 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852017 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852019 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852022 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852024 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852027 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852029 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852032 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852034 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852037 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852039 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:17:53.856588 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852042 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852044 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852047 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852050 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852053 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852061 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852063 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852066 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852069 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852071 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852074 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852076 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852079 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852082 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852084 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852087 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852090 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852092 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852095 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852097 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:17:53.857079 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852100 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852102 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852175 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852183 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852190 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852194 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852200 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852205 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852211 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852217 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852221 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852226 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852229 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852232 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852236 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852239 2562 flags.go:64] FLAG: --cgroup-root="" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852241 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852246 2562 flags.go:64] FLAG: --client-ca-file="" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852249 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852252 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852256 2562 flags.go:64] FLAG: --cluster-domain="" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852259 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852263 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852266 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 03:17:53.857607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852269 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852273 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852276 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852279 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852282 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852285 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852288 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852291 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852294 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852297 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852301 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852304 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852308 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852311 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852314 2562 flags.go:64] FLAG: --enable-server="true" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852317 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852321 2562 flags.go:64] FLAG: --event-burst="100" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852324 2562 flags.go:64] FLAG: --event-qps="50" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852327 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852330 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852333 2562 flags.go:64] FLAG: --eviction-hard="" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852336 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852339 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852342 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852345 2562 flags.go:64] FLAG: --eviction-soft="" Jun 15 03:17:53.858187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852349 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852352 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852355 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852358 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852360 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852363 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852366 2562 flags.go:64] FLAG: --feature-gates="" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852370 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852373 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852376 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852379 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852382 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852385 2562 flags.go:64] FLAG: --help="false" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852387 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-128-105.ec2.internal" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852390 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852393 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852396 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852400 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852403 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852406 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852409 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852412 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852415 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 03:17:53.858823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852418 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852421 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852424 2562 flags.go:64] FLAG: --kube-reserved="" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852428 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852431 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852434 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852437 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852440 2562 flags.go:64] FLAG: --lock-file="" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852443 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852446 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852450 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852455 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852457 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852460 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852463 2562 flags.go:64] FLAG: --logging-format="text" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852466 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852469 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852473 2562 flags.go:64] FLAG: --manifest-url="" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852475 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852479 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852482 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852486 2562 flags.go:64] FLAG: --max-pods="110" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852489 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852492 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852495 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 03:17:53.859504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852498 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852501 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852504 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852507 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852513 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852517 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852520 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852523 2562 flags.go:64] FLAG: --pod-cidr="" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852526 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852531 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852534 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852539 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852542 2562 flags.go:64] FLAG: --port="10250" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852545 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852548 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-022da15d1b3210fbe" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852551 2562 flags.go:64] FLAG: --qos-reserved="" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852555 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852558 2562 flags.go:64] FLAG: --register-node="true" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852561 2562 flags.go:64] FLAG: --register-with-taints="" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852565 2562 flags.go:64] FLAG: --registry-burst="10" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852568 2562 flags.go:64] FLAG: --registry-qps="5" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852571 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852573 2562 flags.go:64] FLAG: --reserved-memory="" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852577 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852580 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 03:17:53.860137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852583 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852586 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852589 2562 flags.go:64] FLAG: --runonce="false" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852592 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852594 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852598 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852600 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852603 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852606 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852609 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852612 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852615 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852618 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852621 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852624 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852627 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852630 2562 flags.go:64] FLAG: --system-cgroups="" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852633 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852639 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852642 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852645 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852649 2562 flags.go:64] FLAG: --tls-min-version="" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852652 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852654 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852657 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 03:17:53.860992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852660 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852663 2562 flags.go:64] FLAG: --v="2" Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852667 2562 flags.go:64] FLAG: --version="false" Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852671 2562 flags.go:64] FLAG: --vmodule="" Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852674 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.852677 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852784 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852788 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852790 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852793 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852796 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852798 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852801 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852804 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852806 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852809 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852811 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852814 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852816 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852819 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852822 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:17:53.861716 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852825 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852830 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852832 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852835 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852839 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852841 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852845 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852849 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852852 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852854 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852857 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852859 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852862 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852864 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852867 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852869 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852872 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852874 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852877 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852879 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:17:53.862253 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852882 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852884 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852887 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852891 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852895 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852898 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852901 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852904 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852907 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852910 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852912 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852915 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852918 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852922 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852925 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852927 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852943 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852946 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852949 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:17:53.862785 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852952 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852954 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852957 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852960 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852962 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852965 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852967 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852970 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852973 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852975 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852978 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852981 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852983 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852986 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852989 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852991 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852994 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852996 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.852999 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853002 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:17:53.863327 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853004 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853006 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853009 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853012 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853014 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853017 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853021 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853024 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853027 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853031 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853033 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853036 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853038 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853041 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853044 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853046 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853049 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853052 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853054 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:17:53.863820 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853056 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853059 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853062 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853064 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853067 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.853071 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.853895 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.862655 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.862670 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.863580 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.863589 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863651 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863656 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863660 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:17:53.864282 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863662 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863665 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863668 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863671 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863674 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863677 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863680 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863683 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863686 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863690 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863693 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863696 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863698 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863701 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863704 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863706 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863709 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863712 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863715 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863717 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:17:53.864629 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863720 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863722 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863725 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863728 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863730 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863733 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863735 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863738 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863740 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863743 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863746 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863748 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863751 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863753 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863756 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863758 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863761 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863763 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863766 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863768 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:17:53.865132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863771 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863775 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863779 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863782 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863785 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863788 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863791 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863794 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863797 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863800 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863803 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863805 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863808 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863811 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863813 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863816 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863818 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863821 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863824 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:17:53.865618 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863826 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863829 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863832 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863834 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863837 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863840 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863843 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863845 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863848 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863850 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863853 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863856 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863858 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863861 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863863 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863866 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863869 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863872 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863875 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863877 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:17:53.866153 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863880 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863882 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863885 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863887 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863891 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863895 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863898 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863901 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863903 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863906 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863908 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863910 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863913 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863915 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863918 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863922 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:17:53.866641 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.863925 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.863945 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864062 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864067 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864070 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864073 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864076 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864078 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864081 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864084 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864086 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864089 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864092 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864094 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864097 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 03:17:53.867132 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864100 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864104 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864108 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864111 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864114 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864117 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864120 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864123 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864125 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864128 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864131 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864133 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864136 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864139 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864141 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864144 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864146 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864149 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864152 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864154 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 03:17:53.867487 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864158 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864161 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864164 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864167 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864169 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864172 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864176 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864179 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864183 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864185 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864188 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864190 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864193 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864196 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864198 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864201 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864204 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864206 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864209 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 03:17:53.868049 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864211 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864214 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864216 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864219 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864221 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864224 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864227 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864229 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864231 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864234 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864236 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864239 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864242 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864244 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864246 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864249 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864251 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864254 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864256 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864259 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 03:17:53.868551 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864261 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864264 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864267 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864270 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864272 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864274 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864277 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864280 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864282 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864285 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864288 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864290 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864293 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864296 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864298 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864301 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864304 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864306 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864308 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864311 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 03:17:53.869037 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864313 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864316 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864319 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864321 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864324 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864326 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:53.864328 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.864333 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.864433 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.867657 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.869333 2562 server.go:1019] "Starting client certificate rotation" Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.869438 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 03:17:53.869534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.869467 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 03:17:53.872180 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.872162 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 03:17:53.873333 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.873311 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 03:17:53.884026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.884011 2562 log.go:25] "Validated CRI v1 runtime API" Jun 15 03:17:53.888059 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.888039 2562 log.go:25] "Validated CRI v1 image API" Jun 15 03:17:53.888996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.888977 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 03:17:53.893542 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.893517 2562 fs.go:135] Filesystem UUIDs: map[1d1a2102-8ffe-4ef1-972f-0bb776df09a7:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c16a5122-1795-407c-8820-1208a6f48afc:/dev/nvme0n1p3] Jun 15 03:17:53.893607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.893540 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 03:17:53.898399 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.898291 2562 manager.go:216] Machine: {Timestamp:2026-06-15 03:17:53.896960741 +0000 UTC m=+0.371896190 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3002592 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec209a0dd5ccc43550e415cd35323af2 SystemUUID:ec209a0d-d5cc-c435-50e4-15cd35323af2 BootID:e2a676bc-846b-4f8e-b102-cdba12ac9d19 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:01:5b:b3:3c:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:01:5b:b3:3c:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:bf:a9:9c:6b:1a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 03:17:53.898399 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.898392 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 03:17:53.898522 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.898467 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 03:17:53.900086 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.900070 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 03:17:53.901949 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.901909 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 03:17:53.902105 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.901983 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-105.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 03:17:53.903480 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.903469 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 03:17:53.903515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.903482 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 03:17:53.903515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.903490 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 03:17:53.903515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.903509 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 03:17:53.905440 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.905430 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 03:17:53.910183 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910171 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 15 03:17:53.910439 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910429 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 03:17:53.910479 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910459 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 15 03:17:53.910479 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910469 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 03:17:53.910530 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910488 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 03:17:53.910530 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910497 2562 kubelet.go:398] "Adding apiserver pod source" Jun 15 03:17:53.910530 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.910506 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 03:17:53.912179 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.912156 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 03:17:53.912261 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.912193 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 03:17:53.915054 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.915033 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 03:17:53.917608 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.917583 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 03:17:53.917686 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.917634 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 03:17:53.918482 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918470 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918488 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918495 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918500 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918509 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918514 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918522 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 03:17:53.918525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918527 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 03:17:53.918701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918533 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 03:17:53.918701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918538 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 03:17:53.918701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918547 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 03:17:53.918701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.918552 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 03:17:53.919378 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.919368 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 03:17:53.919378 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.919378 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 03:17:53.922516 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.922499 2562 server.go:1268] "Started kubelet" Jun 15 03:17:53.922621 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.922585 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 03:17:53.922679 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.922584 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 03:17:53.922679 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.922657 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 03:17:53.923298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.923280 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-105.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 03:17:53.923491 ip-10-0-128-105 systemd[1]: Started Kubernetes Kubelet. Jun 15 03:17:53.924055 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.923867 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 03:17:53.924055 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.923869 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 03:17:53.924764 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.924749 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 03:17:53.925063 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.925050 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 15 03:17:53.930742 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.929570 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-105.ec2.internal.18b922e032d36597 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-105.ec2.internal,UID:ip-10-0-128-105.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-105.ec2.internal,},FirstTimestamp:2026-06-15 03:17:53.922475415 +0000 UTC m=+0.397410860,LastTimestamp:2026-06-15 03:17:53.922475415 +0000 UTC m=+0.397410860,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-105.ec2.internal,}" Jun 15 03:17:53.932445 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.932353 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 03:17:53.933032 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933015 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 03:17:53.933112 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933038 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 03:17:53.933196 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.933178 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:53.933833 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933817 2562 factory.go:55] Registering systemd factory Jun 15 03:17:53.933833 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933835 2562 factory.go:223] Registration of the systemd container factory successfully Jun 15 03:17:53.933961 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933853 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 03:17:53.933961 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933865 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 03:17:53.933961 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933885 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933977 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.933986 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.934033 2562 factory.go:153] Registering CRI-O factory Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.934046 2562 factory.go:223] Registration of the crio container factory successfully Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.934095 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.934118 2562 factory.go:103] Registering Raw factory Jun 15 03:17:53.934154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.934134 2562 manager.go:1196] Started watching for new ooms in manager Jun 15 03:17:53.934739 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.934705 2562 manager.go:349] Starting recovery of all containers Jun 15 03:17:53.934902 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.934881 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-105.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 03:17:53.935099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.935075 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 03:17:53.942515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.942357 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 03:17:53.946040 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.946020 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vp64z" Jun 15 03:17:53.946213 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.946201 2562 manager.go:354] Recovery completed Jun 15 03:17:53.950193 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.950181 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:53.951903 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.951886 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:53.952005 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.951917 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:53.952005 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.951949 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:53.952442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.952426 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 03:17:53.952503 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.952443 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 03:17:53.952503 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.952451 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:53.952503 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.952462 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 15 03:17:53.953084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.953072 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:53.953135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.953095 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:53.953135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.953105 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:53.954079 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.954064 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vp64z" Jun 15 03:17:53.955415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.955403 2562 policy_none.go:49] "None policy: Start" Jun 15 03:17:53.955460 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.955418 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 03:17:53.955460 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.955432 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 03:17:53.957389 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.957376 2562 policy_none.go:47] "Start" Jun 15 03:17:53.999511 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999497 2562 manager.go:337] "Starting Device Plugin manager" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:53.999537 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999546 2562 server.go:87] "Starting device plugin registration server" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999771 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999785 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999882 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999966 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:53.999974 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.000589 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.000635 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.010564 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.010596 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.010616 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.010643 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 03:17:54.021380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.012827 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:17:54.100475 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.100444 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:54.101318 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.101303 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:54.101401 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.101334 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:54.101401 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.101347 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:54.101401 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.101375 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.110630 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.110617 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.110675 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.110637 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-105.ec2.internal\": node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.110726 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.110683 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal"] Jun 15 03:17:54.110775 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.110744 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:54.112210 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.112197 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:54.112273 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.112220 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:54.112273 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.112229 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:54.114504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.114490 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:54.114618 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.114604 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.114674 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.114640 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:54.115148 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.115136 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:54.115218 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.115148 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:54.115218 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.115162 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:54.115218 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.115177 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:54.115360 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.115165 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:54.115360 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.115243 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:54.117504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.117463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.117504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.117486 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 03:17:54.118160 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.118145 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientMemory" Jun 15 03:17:54.118239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.118168 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 03:17:54.118239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.118177 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeHasSufficientPID" Jun 15 03:17:54.134778 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.134756 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19c4b02f1dd1551974a85a2db4841ab1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"19c4b02f1dd1551974a85a2db4841ab1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.134856 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.134782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c4b02f1dd1551974a85a2db4841ab1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"19c4b02f1dd1551974a85a2db4841ab1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.134856 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.134799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee2e1426c7d8d6fc3f7c93a631682417-config\") pod \"kube-apiserver-proxy-ip-10-0-128-105.ec2.internal\" (UID: \"ee2e1426c7d8d6fc3f7c93a631682417\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.141301 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.141276 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.146494 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.146480 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-105.ec2.internal\" not found" node="ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.151321 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.151305 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-105.ec2.internal\" not found" node="ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.235688 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.235667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19c4b02f1dd1551974a85a2db4841ab1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"19c4b02f1dd1551974a85a2db4841ab1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.235799 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.235691 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c4b02f1dd1551974a85a2db4841ab1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"19c4b02f1dd1551974a85a2db4841ab1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.235799 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.235707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee2e1426c7d8d6fc3f7c93a631682417-config\") pod \"kube-apiserver-proxy-ip-10-0-128-105.ec2.internal\" (UID: \"ee2e1426c7d8d6fc3f7c93a631682417\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.235799 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.235742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee2e1426c7d8d6fc3f7c93a631682417-config\") pod \"kube-apiserver-proxy-ip-10-0-128-105.ec2.internal\" (UID: \"ee2e1426c7d8d6fc3f7c93a631682417\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.235799 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.235770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/19c4b02f1dd1551974a85a2db4841ab1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"19c4b02f1dd1551974a85a2db4841ab1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.235799 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.235772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19c4b02f1dd1551974a85a2db4841ab1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal\" (UID: \"19c4b02f1dd1551974a85a2db4841ab1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.241786 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.241770 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.342256 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.342221 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.443113 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.443039 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.450192 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.450171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.455085 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.455007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jun 15 03:17:54.543163 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.543130 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.643681 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.643642 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.744231 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.744163 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.844837 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.844809 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.868997 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.868964 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 03:17:54.869593 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.869120 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 03:17:54.945139 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:54.945111 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:54.960276 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.960244 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 03:12:53 +0000 UTC" deadline="2028-02-25 22:55:01.45992514 +0000 UTC" Jun 15 03:17:54.960276 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.960269 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14899h37m6.499659587s" Jun 15 03:17:54.979573 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:54.979544 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee2e1426c7d8d6fc3f7c93a631682417.slice/crio-8febaa3fa0a1600942d9a2aebb8a084c422dc1db78b2f7b638b2c8db8108b2bc WatchSource:0}: Error finding container 8febaa3fa0a1600942d9a2aebb8a084c422dc1db78b2f7b638b2c8db8108b2bc: Status 404 returned error can't find the container with id 8febaa3fa0a1600942d9a2aebb8a084c422dc1db78b2f7b638b2c8db8108b2bc Jun 15 03:17:54.979941 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:54.979906 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19c4b02f1dd1551974a85a2db4841ab1.slice/crio-b915028b1343c3de80df43a4833504e8a4bf01ef4fe56d621eed5eef2d1c2d6e WatchSource:0}: Error finding container b915028b1343c3de80df43a4833504e8a4bf01ef4fe56d621eed5eef2d1c2d6e: Status 404 returned error can't find the container with id b915028b1343c3de80df43a4833504e8a4bf01ef4fe56d621eed5eef2d1c2d6e Jun 15 03:17:54.984998 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:54.984974 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:17:55.014585 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.014098 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" event={"ID":"19c4b02f1dd1551974a85a2db4841ab1","Type":"ContainerStarted","Data":"b915028b1343c3de80df43a4833504e8a4bf01ef4fe56d621eed5eef2d1c2d6e"} Jun 15 03:17:55.015056 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.015037 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" event={"ID":"ee2e1426c7d8d6fc3f7c93a631682417","Type":"ContainerStarted","Data":"8febaa3fa0a1600942d9a2aebb8a084c422dc1db78b2f7b638b2c8db8108b2bc"} Jun 15 03:17:55.029567 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.029548 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:17:55.045618 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:55.045601 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:55.146150 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:55.146126 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:55.246671 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:55.246647 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-105.ec2.internal\" not found" Jun 15 03:17:55.311980 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.311901 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:17:55.312120 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.312099 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:17:55.333700 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.333678 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" Jun 15 03:17:55.345740 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.345722 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 03:17:55.346927 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.346899 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" Jun 15 03:17:55.355504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.355489 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 03:17:55.774119 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.774094 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 03:17:55.911474 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.911446 2562 apiserver.go:52] "Watching apiserver" Jun 15 03:17:55.917899 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.917870 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 03:17:55.919345 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.919313 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal","openshift-cluster-node-tuning-operator/tuned-kdxmr","openshift-image-registry/node-ca-dn248","openshift-multus/network-metrics-daemon-bk8st","openshift-network-operator/iptables-alerter-swztw","kube-system/global-pull-secret-syncer-8bp2g","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2","openshift-dns/node-resolver-ql7z8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal","openshift-multus/multus-additional-cni-plugins-kzb9f","openshift-multus/multus-zkjpr","openshift-network-diagnostics/network-check-target-hfvvs","openshift-ovn-kubernetes/ovnkube-node-p5f9v","kube-system/konnectivity-agent-ncb7d"] Jun 15 03:17:55.921999 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.921974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.924282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.924257 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 03:17:55.924498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.924482 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.924700 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.924670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.924700 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.924683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.924834 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.924684 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x2p8x\"" Jun 15 03:17:55.926904 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.926479 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:55.927552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927143 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 03:17:55.927552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927325 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 03:17:55.927552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927392 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 03:17:55.927552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tgc2v\"" Jun 15 03:17:55.927783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927578 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.927783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927658 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.928042 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.927949 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 03:17:55.928273 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.928254 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.929177 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.928647 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qv8zl\"" Jun 15 03:17:55.929177 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.928706 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 03:17:55.929177 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.928960 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.929177 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.929011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:55.929177 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:55.929089 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:17:55.931361 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.931334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:55.933726 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.933586 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bzfdt\"" Jun 15 03:17:55.933726 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.933600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.933726 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.933655 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.933956 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.933803 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 03:17:55.933956 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.933838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:55.933956 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:55.933897 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:17:55.934155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.934132 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 03:17:55.935908 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.935889 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:55.937879 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.937861 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 03:17:55.938128 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.938112 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wpjmw\"" Jun 15 03:17:55.938271 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.938248 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 03:17:55.939192 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.939172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:55.940801 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.940783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.941313 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.941297 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5lrgw\"" Jun 15 03:17:55.941521 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.941451 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.942133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.942115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:55.943236 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3c91368-d1e3-4e81-919c-74c21b07631d-konnectivity-ca\") pod \"konnectivity-agent-ncb7d\" (UID: \"a3c91368-d1e3-4e81-919c-74c21b07631d\") " pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:55.943236 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-run-ovn-kubernetes\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.943385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovnkube-config\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.943385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943280 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/629863d9-1ff0-47ce-bf85-38d078b40b36-serviceca\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:55.943385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sb8g8\" (UniqueName: \"kubernetes.io/projected/629863d9-1ff0-47ce-bf85-38d078b40b36-kube-api-access-sb8g8\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:55.943385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-device-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.943385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943346 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-iptables-alerter-script\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80a405e9-d122-4234-8d5b-7957e771d871-kubelet-config\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhbms\" (UniqueName: \"kubernetes.io/projected/50486edf-f3f6-4da6-bf76-65c1b6388548-kube-api-access-bhbms\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943506 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3c91368-d1e3-4e81-919c-74c21b07631d-agent-certs\") pod \"konnectivity-agent-ncb7d\" (UID: \"a3c91368-d1e3-4e81-919c-74c21b07631d\") " pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-systemd-units\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl62x\" (UniqueName: \"kubernetes.io/projected/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-kube-api-access-pl62x\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:55.943611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-kubelet\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-var-lib-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-etc-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-node-log\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/629863d9-1ff0-47ce-bf85-38d078b40b36-host\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943735 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-registration-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-ovn\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-cni-netd\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943875 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80a405e9-d122-4234-8d5b-7957e771d871-dbus\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-run-netns\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovn-node-metrics-cert\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943977 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.943999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-slash\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-cni-bin\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovnkube-script-lib\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tblrn\" (UniqueName: \"kubernetes.io/projected/b767ab3d-231d-4c4d-8fad-6d3f0626977a-kube-api-access-tblrn\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-sys-fs\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944167 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-host-slash\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-log-socket\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-systemd\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944231 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-env-overrides\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-socket-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr2hv\" (UniqueName: \"kubernetes.io/projected/ff9e78c1-4170-45bf-ab25-e2d203867826-kube-api-access-gr2hv\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944410 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zfd7j\"" Jun 15 03:17:55.944803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.944599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:55.946658 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.946639 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 03:17:55.946759 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.946683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 03:17:55.946759 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.946686 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 03:17:55.946759 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.946702 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 03:17:55.946918 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.946835 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 03:17:55.946986 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.946966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zkjpr" Jun 15 03:17:55.947030 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.947017 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9vpbk\"" Jun 15 03:17:55.947617 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.947602 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 03:17:55.948803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.948787 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xwlfk\"" Jun 15 03:17:55.948925 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.948913 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 03:17:55.949345 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.949330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:55.949393 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:55.949377 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:17:55.972369 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.972353 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ndl6q" Jun 15 03:17:55.978250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:55.978232 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ndl6q" Jun 15 03:17:56.035376 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.035306 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 03:17:56.045210 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr2hv\" (UniqueName: \"kubernetes.io/projected/ff9e78c1-4170-45bf-ab25-e2d203867826-kube-api-access-gr2hv\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.045308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045220 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysconfig\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.045308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-host\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.045308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cnibin\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.045308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-run-ovn-kubernetes\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-device-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-iptables-alerter-script\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-run-ovn-kubernetes\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80a405e9-d122-4234-8d5b-7957e771d871-kubelet-config\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045384 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-device-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-cnibin\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-os-release\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-lib-modules\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045445 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/80a405e9-d122-4234-8d5b-7957e771d871-kubelet-config\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045514 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhbms\" (UniqueName: \"kubernetes.io/projected/50486edf-f3f6-4da6-bf76-65c1b6388548-kube-api-access-bhbms\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045557 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-hostroot\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-etc-kubernetes\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-modprobe-d\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-tuned\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-os-release\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-systemd-units\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl62x\" (UniqueName: \"kubernetes.io/projected/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-kube-api-access-pl62x\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045804 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-systemd-units\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-kubelet\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-iptables-alerter-script\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-systemd\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.045966 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-kubelet\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-ovn\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80a405e9-d122-4234-8d5b-7957e771d871-dbus\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-system-cni-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-run-netns\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.045964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovn-node-metrics-cert\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-cni-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-run-netns\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3156802b-8294-4dda-8a42-dc5bbce1ae06-cni-binary-copy\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-netns\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-ovn\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046066 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/80a405e9-d122-4234-8d5b-7957e771d871-dbus\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046118 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-conf-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-daemon-config\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-slash\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-cni-bin\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.046750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-slash\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-cni-bin\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tblrn\" (UniqueName: \"kubernetes.io/projected/b767ab3d-231d-4c4d-8fad-6d3f0626977a-kube-api-access-tblrn\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-sys-fs\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-socket-dir-parent\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e2cc84-3226-4570-a27d-364263a5b4c3-tmp\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-log-socket\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046337 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-log-socket\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-socket-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046372 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-sys-fs\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3c91368-d1e3-4e81-919c-74c21b07631d-konnectivity-ca\") pod \"konnectivity-agent-ncb7d\" (UID: \"a3c91368-d1e3-4e81-919c-74c21b07631d\") " pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-cni-multus\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-kubelet\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-socket-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046473 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmpdq\" (UniqueName: \"kubernetes.io/projected/ef8418f2-cd72-4c95-906c-d234ad1e5445-kube-api-access-vmpdq\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.047456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-sys\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovnkube-config\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/629863d9-1ff0-47ce-bf85-38d078b40b36-serviceca\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sb8g8\" (UniqueName: \"kubernetes.io/projected/629863d9-1ff0-47ce-bf85-38d078b40b36-kube-api-access-sb8g8\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef8418f2-cd72-4c95-906c-d234ad1e5445-tmp-dir\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046681 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3c91368-d1e3-4e81-919c-74c21b07631d-agent-certs\") pod \"konnectivity-agent-ncb7d\" (UID: \"a3c91368-d1e3-4e81-919c-74c21b07631d\") " pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-k8s-cni-cncf-io\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysctl-conf\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-system-cni-dir\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-run\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.046901 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-var-lib-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.046984 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:17:56.546964826 +0000 UTC m=+3.021900294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:56.048026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-var-lib-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-etc-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-node-log\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/629863d9-1ff0-47ce-bf85-38d078b40b36-host\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-registration-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.046884 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a3c91368-d1e3-4e81-919c-74c21b07631d-konnectivity-ca\") pod \"konnectivity-agent-ncb7d\" (UID: \"a3c91368-d1e3-4e81-919c-74c21b07631d\") " pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047082 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovnkube-config\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysctl-d\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/629863d9-1ff0-47ce-bf85-38d078b40b36-serviceca\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-etc-openvswitch\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/629863d9-1ff0-47ce-bf85-38d078b40b36-host\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7ldn\" (UniqueName: \"kubernetes.io/projected/2fa42666-b6c2-4e6e-800a-a4262affe3e9-kube-api-access-t7ldn\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-node-log\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-cni-netd\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-registration-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.047204 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-var-lib-kubelet\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.048553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-host-cni-netd\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.047258 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:17:56.547243054 +0000 UTC m=+3.022178492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnr8f\" (UniqueName: \"kubernetes.io/projected/3156802b-8294-4dda-8a42-dc5bbce1ae06-kube-api-access-xnr8f\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff9e78c1-4170-45bf-ab25-e2d203867826-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-kubernetes\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbds8\" (UniqueName: \"kubernetes.io/projected/a6e2cc84-3226-4570-a27d-364263a5b4c3-kube-api-access-nbds8\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovnkube-script-lib\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-host-slash\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-cni-bin\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-multus-certs\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047435 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-host-slash\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef8418f2-cd72-4c95-906c-d234ad1e5445-hosts-file\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047471 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-systemd\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-env-overrides\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047531 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b767ab3d-231d-4c4d-8fad-6d3f0626977a-run-systemd\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049155 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-env-overrides\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049848 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.047875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovnkube-script-lib\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049848 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.049627 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b767ab3d-231d-4c4d-8fad-6d3f0626977a-ovn-node-metrics-cert\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.049848 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.049653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a3c91368-d1e3-4e81-919c-74c21b07631d-agent-certs\") pod \"konnectivity-agent-ncb7d\" (UID: \"a3c91368-d1e3-4e81-919c-74c21b07631d\") " pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:56.053249 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.053228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl62x\" (UniqueName: \"kubernetes.io/projected/2a48b15f-d3e4-432c-a2e4-fcf9a417e06f-kube-api-access-pl62x\") pod \"iptables-alerter-swztw\" (UID: \"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f\") " pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.053359 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.053328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr2hv\" (UniqueName: \"kubernetes.io/projected/ff9e78c1-4170-45bf-ab25-e2d203867826-kube-api-access-gr2hv\") pod \"aws-ebs-csi-driver-node-ztfp2\" (UID: \"ff9e78c1-4170-45bf-ab25-e2d203867826\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.053777 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.053756 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhbms\" (UniqueName: \"kubernetes.io/projected/50486edf-f3f6-4da6-bf76-65c1b6388548-kube-api-access-bhbms\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:56.054623 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.054598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tblrn\" (UniqueName: \"kubernetes.io/projected/b767ab3d-231d-4c4d-8fad-6d3f0626977a-kube-api-access-tblrn\") pod \"ovnkube-node-p5f9v\" (UID: \"b767ab3d-231d-4c4d-8fad-6d3f0626977a\") " pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.054946 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.054915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sb8g8\" (UniqueName: \"kubernetes.io/projected/629863d9-1ff0-47ce-bf85-38d078b40b36-kube-api-access-sb8g8\") pod \"node-ca-dn248\" (UID: \"629863d9-1ff0-47ce-bf85-38d078b40b36\") " pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.148194 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-run\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysctl-d\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7ldn\" (UniqueName: \"kubernetes.io/projected/2fa42666-b6c2-4e6e-800a-a4262affe3e9-kube-api-access-t7ldn\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-var-lib-kubelet\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnr8f\" (UniqueName: \"kubernetes.io/projected/3156802b-8294-4dda-8a42-dc5bbce1ae06-kube-api-access-xnr8f\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-run\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-kubernetes\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbds8\" (UniqueName: \"kubernetes.io/projected/a6e2cc84-3226-4570-a27d-364263a5b4c3-kube-api-access-nbds8\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-cni-bin\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148347 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysctl-d\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-multus-certs\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-kubernetes\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-cni-bin\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-var-lib-kubelet\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef8418f2-cd72-4c95-906c-d234ad1e5445-hosts-file\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148439 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-multus-certs\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysconfig\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-host\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysconfig\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cnibin\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ef8418f2-cd72-4c95-906c-d234ad1e5445-hosts-file\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-cnibin\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cnibin\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-os-release\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-host\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-lib-modules\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-cnibin\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.148750 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-hostroot\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148642 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-etc-kubernetes\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148664 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-modprobe-d\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-os-release\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-tuned\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-lib-modules\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-hostroot\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148723 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-etc-kubernetes\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-os-release\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-os-release\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148774 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-modprobe-d\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-systemd\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-system-cni-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-cni-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3156802b-8294-4dda-8a42-dc5bbce1ae06-cni-binary-copy\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.149605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-netns\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148983 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-system-cni-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-conf-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.148983 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-systemd\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-daemon-config\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-cni-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149040 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-netns\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-socket-dir-parent\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-conf-dir\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e2cc84-3226-4570-a27d-364263a5b4c3-tmp\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-socket-dir-parent\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149166 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-cni-multus\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-kubelet\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmpdq\" (UniqueName: \"kubernetes.io/projected/ef8418f2-cd72-4c95-906c-d234ad1e5445-kube-api-access-vmpdq\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149251 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-sys\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef8418f2-cd72-4c95-906c-d234ad1e5445-tmp-dir\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-k8s-cni-cncf-io\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysctl-conf\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-system-cni-dir\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149417 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149531 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-sys\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-cni-multus\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3156802b-8294-4dda-8a42-dc5bbce1ae06-cni-binary-copy\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149644 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-var-lib-kubelet\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-cni-binary-copy\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149666 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2fa42666-b6c2-4e6e-800a-a4262affe3e9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2fa42666-b6c2-4e6e-800a-a4262affe3e9-system-cni-dir\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3156802b-8294-4dda-8a42-dc5bbce1ae06-host-run-k8s-cni-cncf-io\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149800 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-sysctl-conf\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.149836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef8418f2-cd72-4c95-906c-d234ad1e5445-tmp-dir\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.150720 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.150221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3156802b-8294-4dda-8a42-dc5bbce1ae06-multus-daemon-config\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.151196 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.150963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a6e2cc84-3226-4570-a27d-364263a5b4c3-etc-tuned\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.151328 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.151310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6e2cc84-3226-4570-a27d-364263a5b4c3-tmp\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.155113 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.155091 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:17:56.155217 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.155120 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:17:56.155217 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.155133 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:56.155217 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.155203 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:17:56.655185765 +0000 UTC m=+3.130121218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:56.156535 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.156499 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnr8f\" (UniqueName: \"kubernetes.io/projected/3156802b-8294-4dda-8a42-dc5bbce1ae06-kube-api-access-xnr8f\") pod \"multus-zkjpr\" (UID: \"3156802b-8294-4dda-8a42-dc5bbce1ae06\") " pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.156639 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.156550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7ldn\" (UniqueName: \"kubernetes.io/projected/2fa42666-b6c2-4e6e-800a-a4262affe3e9-kube-api-access-t7ldn\") pod \"multus-additional-cni-plugins-kzb9f\" (UID: \"2fa42666-b6c2-4e6e-800a-a4262affe3e9\") " pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.156791 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.156773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbds8\" (UniqueName: \"kubernetes.io/projected/a6e2cc84-3226-4570-a27d-364263a5b4c3-kube-api-access-nbds8\") pod \"tuned-kdxmr\" (UID: \"a6e2cc84-3226-4570-a27d-364263a5b4c3\") " pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.156989 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.156975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmpdq\" (UniqueName: \"kubernetes.io/projected/ef8418f2-cd72-4c95-906c-d234ad1e5445-kube-api-access-vmpdq\") pod \"node-resolver-ql7z8\" (UID: \"ef8418f2-cd72-4c95-906c-d234ad1e5445\") " pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.235705 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.235679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" Jun 15 03:17:56.246077 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.246054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:17:56.246387 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:56.246358 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff9e78c1_4170_45bf_ab25_e2d203867826.slice/crio-60bb086a7a662a5b4cba195f61614b344ff079f0ac1e422fdf2ab34e0ea2626b WatchSource:0}: Error finding container 60bb086a7a662a5b4cba195f61614b344ff079f0ac1e422fdf2ab34e0ea2626b: Status 404 returned error can't find the container with id 60bb086a7a662a5b4cba195f61614b344ff079f0ac1e422fdf2ab34e0ea2626b Jun 15 03:17:56.253070 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.253050 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dn248" Jun 15 03:17:56.254783 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:56.254751 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb767ab3d_231d_4c4d_8fad_6d3f0626977a.slice/crio-5e68d4cc47a7230f766eaf1ac4231d3d7a27c9ff8d072251d4c869445e18b8d8 WatchSource:0}: Error finding container 5e68d4cc47a7230f766eaf1ac4231d3d7a27c9ff8d072251d4c869445e18b8d8: Status 404 returned error can't find the container with id 5e68d4cc47a7230f766eaf1ac4231d3d7a27c9ff8d072251d4c869445e18b8d8 Jun 15 03:17:56.256793 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.256775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-swztw" Jun 15 03:17:56.261848 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:56.261830 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod629863d9_1ff0_47ce_bf85_38d078b40b36.slice/crio-66014bfc9230f5fc6efd8931cec5119d78d61a8063f548707a7c6c6909ed654d WatchSource:0}: Error finding container 66014bfc9230f5fc6efd8931cec5119d78d61a8063f548707a7c6c6909ed654d: Status 404 returned error can't find the container with id 66014bfc9230f5fc6efd8931cec5119d78d61a8063f548707a7c6c6909ed654d Jun 15 03:17:56.261950 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.261884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:17:56.268248 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.268233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ql7z8" Jun 15 03:17:56.273148 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.273131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" Jun 15 03:17:56.278634 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.278616 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" Jun 15 03:17:56.283248 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.283232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zkjpr" Jun 15 03:17:56.553738 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.553650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:56.553738 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.553721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:56.553914 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.553815 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:56.553914 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.553817 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:56.553914 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.553867 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:17:57.553853103 +0000 UTC m=+4.028788534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:56.553914 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.553880 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:17:57.553874186 +0000 UTC m=+4.028809618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:56.598024 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:56.597996 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a48b15f_d3e4_432c_a2e4_fcf9a417e06f.slice/crio-866d8d428b959ad7784f7b477b5db3f34a8bcd94e4b8f714fe1e2c7c10530c5b WatchSource:0}: Error finding container 866d8d428b959ad7784f7b477b5db3f34a8bcd94e4b8f714fe1e2c7c10530c5b: Status 404 returned error can't find the container with id 866d8d428b959ad7784f7b477b5db3f34a8bcd94e4b8f714fe1e2c7c10530c5b Jun 15 03:17:56.754682 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.754652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:56.754861 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.754842 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:17:56.754915 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.754866 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:17:56.754915 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.754878 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:56.755024 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:56.754955 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:17:57.754927046 +0000 UTC m=+4.229862494 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:56.982110 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.982001 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 03:12:55 +0000 UTC" deadline="2028-01-14 15:02:48.69817376 +0000 UTC" Jun 15 03:17:56.982110 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:56.982058 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13883h44m51.71611944s" Jun 15 03:17:57.011437 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.011414 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:57.011559 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.011420 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:57.011559 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.011511 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:17:57.011667 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.011611 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:17:57.020633 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.020603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swztw" event={"ID":"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f","Type":"ContainerStarted","Data":"866d8d428b959ad7784f7b477b5db3f34a8bcd94e4b8f714fe1e2c7c10530c5b"} Jun 15 03:17:57.021765 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.021739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dn248" event={"ID":"629863d9-1ff0-47ce-bf85-38d078b40b36","Type":"ContainerStarted","Data":"66014bfc9230f5fc6efd8931cec5119d78d61a8063f548707a7c6c6909ed654d"} Jun 15 03:17:57.023011 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.022989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"5e68d4cc47a7230f766eaf1ac4231d3d7a27c9ff8d072251d4c869445e18b8d8"} Jun 15 03:17:57.024101 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.024078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" event={"ID":"ff9e78c1-4170-45bf-ab25-e2d203867826","Type":"ContainerStarted","Data":"60bb086a7a662a5b4cba195f61614b344ff079f0ac1e422fdf2ab34e0ea2626b"} Jun 15 03:17:57.359319 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:57.359283 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6e2cc84_3226_4570_a27d_364263a5b4c3.slice/crio-1c3174b85c2a69d1474d00a4b6aac46e54e9a97e5d0e83472b775634c96676c4 WatchSource:0}: Error finding container 1c3174b85c2a69d1474d00a4b6aac46e54e9a97e5d0e83472b775634c96676c4: Status 404 returned error can't find the container with id 1c3174b85c2a69d1474d00a4b6aac46e54e9a97e5d0e83472b775634c96676c4 Jun 15 03:17:57.359753 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:57.359729 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa42666_b6c2_4e6e_800a_a4262affe3e9.slice/crio-92cbafa5b22714475cc3ca26c49b57b310003cdba58a1d14bd9bb2fd2509e77f WatchSource:0}: Error finding container 92cbafa5b22714475cc3ca26c49b57b310003cdba58a1d14bd9bb2fd2509e77f: Status 404 returned error can't find the container with id 92cbafa5b22714475cc3ca26c49b57b310003cdba58a1d14bd9bb2fd2509e77f Jun 15 03:17:57.360975 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:17:57.360845 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3156802b_8294_4dda_8a42_dc5bbce1ae06.slice/crio-d0c0d552da68a8adf834f18e9350874af8ac40463ddb43302fa7d7828a901ffc WatchSource:0}: Error finding container d0c0d552da68a8adf834f18e9350874af8ac40463ddb43302fa7d7828a901ffc: Status 404 returned error can't find the container with id d0c0d552da68a8adf834f18e9350874af8ac40463ddb43302fa7d7828a901ffc Jun 15 03:17:57.560007 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.559758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:57.560205 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.560038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:57.560266 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.560205 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:57.560266 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.560264 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:17:59.560247496 +0000 UTC m=+6.035182947 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:57.560848 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.560644 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:57.560848 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.560698 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:17:59.560680099 +0000 UTC m=+6.035615531 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:57.763268 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.762536 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:57.763268 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.762729 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:17:57.763268 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.762764 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:17:57.763268 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.762777 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:57.763268 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:57.762837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:17:59.762816174 +0000 UTC m=+6.237751612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:57.982869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.982798 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 03:12:55 +0000 UTC" deadline="2028-03-15 03:57:05.554469148 +0000 UTC" Jun 15 03:17:57.982869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:57.982837 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15336h39m7.571636599s" Jun 15 03:17:58.014419 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.013897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:58.014419 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:58.014045 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:17:58.045304 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.045272 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerStarted","Data":"92cbafa5b22714475cc3ca26c49b57b310003cdba58a1d14bd9bb2fd2509e77f"} Jun 15 03:17:58.060889 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.060860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ncb7d" event={"ID":"a3c91368-d1e3-4e81-919c-74c21b07631d","Type":"ContainerStarted","Data":"4aeb53440ed0d7512c796083ac87a9e041c16f00e919c5dd16dc44ea4b2bc989"} Jun 15 03:17:58.066988 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.066962 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zkjpr" event={"ID":"3156802b-8294-4dda-8a42-dc5bbce1ae06","Type":"ContainerStarted","Data":"d0c0d552da68a8adf834f18e9350874af8ac40463ddb43302fa7d7828a901ffc"} Jun 15 03:17:58.079043 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.079015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" event={"ID":"a6e2cc84-3226-4570-a27d-364263a5b4c3","Type":"ContainerStarted","Data":"1c3174b85c2a69d1474d00a4b6aac46e54e9a97e5d0e83472b775634c96676c4"} Jun 15 03:17:58.093520 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.093204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ql7z8" event={"ID":"ef8418f2-cd72-4c95-906c-d234ad1e5445","Type":"ContainerStarted","Data":"cdbba3acf626a5448c3a43ee2774605a58325c9e03f9d581dbc1447e554a834c"} Jun 15 03:17:58.099204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.099176 2562 generic.go:356] "Generic (PLEG): container finished" podID="19c4b02f1dd1551974a85a2db4841ab1" containerID="9dbb9a10f7a9a0eef89f35969d697570f60e3511ea3adf77cd56af884677c530" exitCode=0 Jun 15 03:17:58.099317 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.099270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" event={"ID":"19c4b02f1dd1551974a85a2db4841ab1","Type":"ContainerDied","Data":"9dbb9a10f7a9a0eef89f35969d697570f60e3511ea3adf77cd56af884677c530"} Jun 15 03:17:58.111814 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:58.111790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" event={"ID":"ee2e1426c7d8d6fc3f7c93a631682417","Type":"ContainerStarted","Data":"c0f695f6edd8482c4273cd1d714102614729992b7b361fc4edbda592b0b1cb9c"} Jun 15 03:17:59.011795 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.011764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:59.012311 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.011888 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:17:59.012311 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.012281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:59.012432 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.012369 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:17:59.121032 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.120998 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" event={"ID":"19c4b02f1dd1551974a85a2db4841ab1","Type":"ContainerStarted","Data":"6ce38936fc27b710483d4063a2c3cca4b43f3314cd7b7bbefa8b39389d5b1732"} Jun 15 03:17:59.134596 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.134540 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-105.ec2.internal" podStartSLOduration=4.134522415 podStartE2EDuration="4.134522415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:17:58.128505959 +0000 UTC m=+4.603441406" watchObservedRunningTime="2026-06-15 03:17:59.134522415 +0000 UTC m=+5.609457870" Jun 15 03:17:59.578489 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.577726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:17:59.578489 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.577775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:17:59.578489 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.577913 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:59.578489 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.577986 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:03.577969701 +0000 UTC m=+10.052905138 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:17:59.578489 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.578410 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:59.578489 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.578458 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:03.578443491 +0000 UTC m=+10.053378931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:17:59.778839 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:17:59.778794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:17:59.779074 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.779053 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:17:59.779158 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.779083 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:17:59.779158 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.779095 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:17:59.779265 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:17:59.779159 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:18:03.779139451 +0000 UTC m=+10.254074889 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:00.015152 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:00.014090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:00.015152 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:00.014230 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:01.011265 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:01.011234 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:01.011442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:01.011251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:01.011442 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:01.011366 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:01.011442 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:01.011417 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:02.010980 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:02.010949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:02.011405 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:02.011098 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:03.011869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:03.011834 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:03.012335 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.012048 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:03.012335 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:03.012295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:03.012492 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.012402 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:03.614673 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:03.614266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:03.614673 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:03.614325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:03.614673 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.614495 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:03.614673 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.614521 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:03.614673 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.614568 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:11.614550421 +0000 UTC m=+18.089485859 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:03.614673 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.614588 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:11.614578043 +0000 UTC m=+18.089513495 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:03.816162 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:03.816123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:03.816377 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.816356 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:03.816474 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.816387 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:03.816474 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.816401 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:03.816474 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:03.816464 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:18:11.816446479 +0000 UTC m=+18.291381913 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:04.012992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:04.012473 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:04.012992 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:04.012596 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:05.012312 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:05.011816 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:05.012312 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:05.011966 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:05.012312 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:05.012224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:05.012629 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:05.012316 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:06.010928 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:06.010895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:06.011441 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:06.011082 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:07.010922 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:07.010891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:07.011099 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:07.010891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:07.011099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:07.011002 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:07.011099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:07.011065 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:08.011233 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:08.011197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:08.011641 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:08.011341 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:08.144228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:08.144190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ncb7d" event={"ID":"a3c91368-d1e3-4e81-919c-74c21b07631d","Type":"ContainerStarted","Data":"cb3eb726772e8d3602c0d8e16bde210db0a338d7e0be1301c2fc9fefc75b3feb"} Jun 15 03:18:08.145985 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:08.145953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dn248" event={"ID":"629863d9-1ff0-47ce-bf85-38d078b40b36","Type":"ContainerStarted","Data":"e54f16b33457a87774dd77d702bb56594494aa0cf441580a0c4a1f7a955861c2"} Jun 15 03:18:08.158553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:08.158504 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-105.ec2.internal" podStartSLOduration=13.158487582 podStartE2EDuration="13.158487582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:17:59.135612288 +0000 UTC m=+5.610547744" watchObservedRunningTime="2026-06-15 03:18:08.158487582 +0000 UTC m=+14.633423036" Jun 15 03:18:08.159088 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:08.159046 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ncb7d" podStartSLOduration=4.105577943 podStartE2EDuration="14.159029788s" totalImagesPullingTime="10.053451845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:08.158277331 +0000 UTC m=+14.633212848" watchObservedRunningTime="2026-06-15 03:18:08.159029788 +0000 UTC m=+14.633965243" Jun 15 03:18:08.172767 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:08.172727 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dn248" podStartSLOduration=2.978864138 podStartE2EDuration="14.172710729s" totalImagesPullingTime="11.193846591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:08.172164989 +0000 UTC m=+14.647100456" watchObservedRunningTime="2026-06-15 03:18:08.172710729 +0000 UTC m=+14.647646184" Jun 15 03:18:09.011125 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:09.011092 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:09.011292 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:09.011093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:09.011292 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:09.011199 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:09.011626 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:09.011302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:09.344350 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:09.344261 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:18:09.344927 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:09.344907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:18:10.011249 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:10.011211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:10.011427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:10.011353 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:11.010879 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:11.010842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:11.011128 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:11.010842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:11.011128 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.011003 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:11.011128 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.011060 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:11.151488 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:11.151458 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 15 03:18:11.677336 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:11.677307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:11.677507 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:11.677344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:11.677507 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.677446 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:11.677507 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.677460 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:11.677635 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.677510 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:27.6774898 +0000 UTC m=+34.152425255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:11.677635 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.677527 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:27.677520504 +0000 UTC m=+34.152455936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:11.878194 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:11.878167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:11.878358 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.878323 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:11.878358 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.878340 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:11.878358 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.878352 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:11.878551 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:11.878404 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:18:27.878389947 +0000 UTC m=+34.353325383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:12.011421 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:12.011355 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:12.011572 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:12.011490 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:13.011515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:13.011487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:13.011971 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:13.011610 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:13.011971 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:13.011639 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:13.011971 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:13.011753 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:14.012492 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:14.012460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:14.012912 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:14.012574 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:15.011716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:15.011677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:15.011987 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:15.011799 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:15.011987 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:15.011864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:15.012076 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:15.011988 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:16.012067 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.011626 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:16.012868 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:16.012193 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:16.171967 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.171928 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"40a97810a49cb78b2e38a37a62ab676bd8b7819cc7c2cb99d32da1f567348625"} Jun 15 03:18:16.172147 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.172008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"7446aedb3e5638c9128be26a6461c0b1da8e802e67b6374de4b046d7382a6e40"} Jun 15 03:18:16.172147 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.172062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"c3bfba54a3ae3d8a759994bafbf5f03bf9583ac69910940bd3370cf186f96e58"} Jun 15 03:18:16.172147 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.172110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"ade8cc12d514ce8cd2bbcef6b537c16ee12443003f6599f400d78b7274167835"} Jun 15 03:18:16.172147 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.172143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"f75b12d42e3dfc755b0eb04bed5bb1691731881d7a76e8e3922eca2f05c20396"} Jun 15 03:18:16.172341 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.172172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"741a282f32471d7386c54f0dcaa0cbd8b703ed96b83aff7c0aca6fe3cdd3853f"} Jun 15 03:18:16.173354 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.173332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" event={"ID":"ff9e78c1-4170-45bf-ab25-e2d203867826","Type":"ContainerStarted","Data":"1d983033ba79122ef198b6d7762685a83e737f744b5bd5ef5159fb7ebfee2684"} Jun 15 03:18:16.174625 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.174603 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fa42666-b6c2-4e6e-800a-a4262affe3e9" containerID="4269343e594eaf288dcfbd6aa8fb5fd02f4b357d5af17dad751969eded8594fa" exitCode=0 Jun 15 03:18:16.174704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.174668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerDied","Data":"4269343e594eaf288dcfbd6aa8fb5fd02f4b357d5af17dad751969eded8594fa"} Jun 15 03:18:16.176130 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.176075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zkjpr" event={"ID":"3156802b-8294-4dda-8a42-dc5bbce1ae06","Type":"ContainerStarted","Data":"60925c482f4409c6890ef2f7091ea005bfdc8efcfa53b8fe146f2b35f7543084"} Jun 15 03:18:16.177402 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.177372 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" event={"ID":"a6e2cc84-3226-4570-a27d-364263a5b4c3","Type":"ContainerStarted","Data":"9241d57175bd3430dcbf5055a523c0b75896689013320ee16390ce9ebad93ee5"} Jun 15 03:18:16.178747 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.178718 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ql7z8" event={"ID":"ef8418f2-cd72-4c95-906c-d234ad1e5445","Type":"ContainerStarted","Data":"5391666cd5c6c4d098cd40aaf3170bcc89488e13e5b3e9ad8f492e5ad64430d3"} Jun 15 03:18:16.211013 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.210963 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zkjpr" podStartSLOduration=3.981840726 podStartE2EDuration="22.210927137s" totalImagesPullingTime="18.229086411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:16.210670201 +0000 UTC m=+22.685605655" watchObservedRunningTime="2026-06-15 03:18:16.210927137 +0000 UTC m=+22.685862591" Jun 15 03:18:16.243446 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.243406 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kdxmr" podStartSLOduration=12.110385875 podStartE2EDuration="22.243393664s" totalImagesPullingTime="10.133007789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:16.243272331 +0000 UTC m=+22.718207784" watchObservedRunningTime="2026-06-15 03:18:16.243393664 +0000 UTC m=+22.718329117" Jun 15 03:18:16.243646 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:16.243628 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ql7z8" podStartSLOduration=12.12009874 podStartE2EDuration="22.243623909s" totalImagesPullingTime="10.123525169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:16.228038872 +0000 UTC m=+22.702974325" watchObservedRunningTime="2026-06-15 03:18:16.243623909 +0000 UTC m=+22.718559363" Jun 15 03:18:17.011156 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:17.011122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:17.011331 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:17.011230 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:17.011331 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:17.011276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:17.011402 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:17.011364 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:17.182861 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:17.182758 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-swztw" event={"ID":"2a48b15f-d3e4-432c-a2e4-fcf9a417e06f","Type":"ContainerStarted","Data":"eabade0e35eacd4b74b65ffa0a0bac5beeeb4fa84e94e4954446ccdcd30fd52c"} Jun 15 03:18:17.196540 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:17.196496 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-swztw" podStartSLOduration=12.317096952 podStartE2EDuration="23.196480441s" totalImagesPullingTime="10.879383489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:17.195874803 +0000 UTC m=+23.670810259" watchObservedRunningTime="2026-06-15 03:18:17.196480441 +0000 UTC m=+23.671415895" Jun 15 03:18:17.217392 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:17.217364 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 03:18:18.011179 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:18.011071 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T03:18:17.217387444Z","UUID":"d46d301a-db81-4296-a201-d89d0f78d035","Handler":null,"Name":"","Endpoint":""} Jun 15 03:18:18.011179 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:18.011150 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:18.011425 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:18.011268 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:18.012549 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:18.012519 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 03:18:18.012678 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:18.012561 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 03:18:18.189432 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:18.189399 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" event={"ID":"ff9e78c1-4170-45bf-ab25-e2d203867826","Type":"ContainerStarted","Data":"7dfd24ad922967b844085fd5472bde484f47c5a27202690c5513696b5f5ed1b8"} Jun 15 03:18:19.011445 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:19.011259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:19.011620 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:19.011258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:19.011620 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:19.011535 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:19.011702 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:19.011608 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:19.195746 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:19.195709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"8b55c2700dfbc4e3223023a37264cab49d37e3a581eeed83aee1d63251db4171"} Jun 15 03:18:19.197690 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:19.197666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" event={"ID":"ff9e78c1-4170-45bf-ab25-e2d203867826","Type":"ContainerStarted","Data":"bc4a72fd499a2edcc0866c4e56bd0d837080885a92422f1c41cef0a575584636"} Jun 15 03:18:19.215005 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:19.214914 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztfp2" podStartSLOduration=11.56700042 podStartE2EDuration="25.214895491s" totalImagesPullingTime="13.647895071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:19.214318654 +0000 UTC m=+25.689254109" watchObservedRunningTime="2026-06-15 03:18:19.214895491 +0000 UTC m=+25.689830946" Jun 15 03:18:20.011802 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:20.011774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:20.011974 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:20.011906 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:21.011634 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.011432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:21.012435 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.011519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:21.012435 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:21.011735 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:21.012435 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:21.011820 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:21.037166 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.037142 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:18:21.037302 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.037264 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 15 03:18:21.037828 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.037695 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ncb7d" Jun 15 03:18:21.207183 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.207142 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" event={"ID":"b767ab3d-231d-4c4d-8fad-6d3f0626977a","Type":"ContainerStarted","Data":"f66826a71de2a10f4fd943228299025e0bb51ebd12295b8f63d1ed2878128333"} Jun 15 03:18:21.229781 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:21.229735 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" podStartSLOduration=7.885046538 podStartE2EDuration="27.229716922s" totalImagesPullingTime="19.344670384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:21.228766215 +0000 UTC m=+27.703701680" watchObservedRunningTime="2026-06-15 03:18:21.229716922 +0000 UTC m=+27.704652378" Jun 15 03:18:22.011492 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.011463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:22.011659 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:22.011586 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:22.210491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.210298 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:18:22.210491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.210389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:18:22.210491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.210438 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:18:22.227131 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.227076 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:18:22.227312 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.227264 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:18:22.419724 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.418840 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bk8st"] Jun 15 03:18:22.419724 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.419036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:22.419724 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:22.419188 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:22.422912 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.422885 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8bp2g"] Jun 15 03:18:22.423036 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.423016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:22.423116 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:22.423098 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:22.429851 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.429825 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfvvs"] Jun 15 03:18:22.429974 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:22.429900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:22.430023 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:22.429987 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:23.213315 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:23.213285 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fa42666-b6c2-4e6e-800a-a4262affe3e9" containerID="68e4a42b1134996a8ecb804164560ca7dafe8b4a2c4dc3060afc02e5a8832934" exitCode=0 Jun 15 03:18:23.213677 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:23.213379 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerDied","Data":"68e4a42b1134996a8ecb804164560ca7dafe8b4a2c4dc3060afc02e5a8832934"} Jun 15 03:18:24.011703 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:24.011672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:24.011869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:24.011793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:24.011869 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:24.011798 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:24.012028 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:24.011900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:24.012028 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:24.011928 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:24.012125 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:24.012040 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:25.218880 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:25.218694 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fa42666-b6c2-4e6e-800a-a4262affe3e9" containerID="0e44055ad3ac2764fdf85b63e14fb65f2fd757a94d48affd5c8ed627340ab48a" exitCode=0 Jun 15 03:18:25.219362 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:25.218781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerDied","Data":"0e44055ad3ac2764fdf85b63e14fb65f2fd757a94d48affd5c8ed627340ab48a"} Jun 15 03:18:26.011265 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:26.011235 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:26.011265 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:26.011260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:26.011462 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:26.011332 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:26.011462 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:26.011407 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:26.011462 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:26.011429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:26.011566 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:26.011498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:27.227915 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:27.227883 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fa42666-b6c2-4e6e-800a-a4262affe3e9" containerID="38f193978dbe5c76ed6b47b518cacf68c2dcfd8379f42399e73775bd9dd3e1bc" exitCode=0 Jun 15 03:18:27.228527 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:27.227953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerDied","Data":"38f193978dbe5c76ed6b47b518cacf68c2dcfd8379f42399e73775bd9dd3e1bc"} Jun 15 03:18:27.704108 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:27.704075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:27.704108 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:27.704110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:27.704339 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.704202 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:27.704339 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.704211 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:27.704339 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.704248 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret podName:80a405e9-d122-4234-8d5b-7957e771d871 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:59.704235849 +0000 UTC m=+66.179171281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret") pod "global-pull-secret-syncer-8bp2g" (UID: "80a405e9-d122-4234-8d5b-7957e771d871") : object "kube-system"/"original-pull-secret" not registered Jun 15 03:18:27.704339 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.704262 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs podName:50486edf-f3f6-4da6-bf76-65c1b6388548 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:59.704254722 +0000 UTC m=+66.179190154 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs") pod "network-metrics-daemon-bk8st" (UID: "50486edf-f3f6-4da6-bf76-65c1b6388548") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 03:18:27.905122 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:27.905087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:27.905290 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.905229 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 03:18:27.905290 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.905249 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 03:18:27.905290 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.905259 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fzz6t for pod openshift-network-diagnostics/network-check-target-hfvvs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:27.905431 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:27.905309 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t podName:71432268-0183-44a0-9869-2b8c1efd7b9f nodeName:}" failed. No retries permitted until 2026-06-15 03:18:59.905295933 +0000 UTC m=+66.380231366 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fzz6t" (UniqueName: "kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t") pod "network-check-target-hfvvs" (UID: "71432268-0183-44a0-9869-2b8c1efd7b9f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 03:18:28.011976 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.011894 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:28.012120 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.011890 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:28.012120 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.012035 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bk8st" podUID="50486edf-f3f6-4da6-bf76-65c1b6388548" Jun 15 03:18:28.012120 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.011903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:28.012120 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.012107 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8bp2g" podUID="80a405e9-d122-4234-8d5b-7957e771d871" Jun 15 03:18:28.012298 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.012178 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfvvs" podUID="71432268-0183-44a0-9869-2b8c1efd7b9f" Jun 15 03:18:28.334446 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.334365 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-105.ec2.internal" event="NodeReady" Jun 15 03:18:28.335029 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.334495 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 03:18:28.365641 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.365551 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-757c745fb4-8585r"] Jun 15 03:18:28.370107 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.370083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.372179 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.372155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lv6bc\"" Jun 15 03:18:28.372179 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.372168 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 03:18:28.372368 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.372186 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 03:18:28.372368 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.372342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 03:18:28.379268 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.379194 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd"] Jun 15 03:18:28.379503 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.379483 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 03:18:28.384999 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.384000 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-dc2m4"] Jun 15 03:18:28.385895 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.385715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.388078 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.388052 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 15 03:18:28.388554 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.388534 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp"] Jun 15 03:18:28.388649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.388631 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.389024 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.389006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 15 03:18:28.389121 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.389052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.389184 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.389168 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qp6m5\"" Jun 15 03:18:28.389328 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.389315 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.390667 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.390649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-jqnw4\"" Jun 15 03:18:28.390765 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.390737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.390828 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.390772 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 03:18:28.390872 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.390831 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 03:18:28.391087 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.391073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.392704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.392679 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg"] Jun 15 03:18:28.393513 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.393061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:28.396996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.395716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.396996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.396080 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.396996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.396271 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 03:18:28.396996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.396376 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7"] Jun 15 03:18:28.396996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.396502 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" Jun 15 03:18:28.396996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.396540 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vhww2\"" Jun 15 03:18:28.398238 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.398219 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.398476 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.398457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-khfh7\"" Jun 15 03:18:28.398623 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.398600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.399594 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.399575 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 03:18:28.400046 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.399999 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-b55b8"] Jun 15 03:18:28.400226 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.400205 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.402407 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.402390 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.403358 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 03:18:28.403456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403370 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-gq8xs\"" Jun 15 03:18:28.403456 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403432 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-757c745fb4-8585r"] Jun 15 03:18:28.403564 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403463 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5btpk"] Jun 15 03:18:28.403564 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403462 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 03:18:28.403564 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403521 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.403707 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.403695 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.406462 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.406443 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 15 03:18:28.406604 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.406453 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 15 03:18:28.406676 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.406609 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.406741 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.406708 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4zbwt\"" Jun 15 03:18:28.406803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.406788 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.407683 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.407666 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-jv7nv"] Jun 15 03:18:28.408463 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.407796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.411130 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.411113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w8plj\"" Jun 15 03:18:28.411416 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.411397 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 03:18:28.411761 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.411743 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7"] Jun 15 03:18:28.413476 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.413237 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 03:18:28.413613 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.413317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:28.417647 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.417602 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 15 03:18:28.419695 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.418915 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 03:18:28.419695 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.419177 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66bd986dc6-w8m6k"] Jun 15 03:18:28.419695 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.418928 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-45fmz\"" Jun 15 03:18:28.420053 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.420032 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.425294 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425275 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf"] Jun 15 03:18:28.426708 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425492 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 03:18:28.426811 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425627 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.426872 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x6wnc\"" Jun 15 03:18:28.426872 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425720 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 03:18:28.427040 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425749 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 03:18:28.427040 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425777 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.427141 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.425982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.430210 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.430190 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.430649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.430629 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 03:18:28.430749 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.430699 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 03:18:28.431050 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.430985 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.431387 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.431370 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 03:18:28.432479 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.431648 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h5v66\"" Jun 15 03:18:28.432789 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.431655 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 03:18:28.433193 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.431821 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wl7rh"] Jun 15 03:18:28.433683 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.431888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" Jun 15 03:18:28.436150 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.435976 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8qlmp\"" Jun 15 03:18:28.436150 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.436010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.436150 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.436118 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.436928 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.436908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7"] Jun 15 03:18:28.437098 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437079 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd"] Jun 15 03:18:28.437208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437110 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-b55b8"] Jun 15 03:18:28.437208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437129 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-dc2m4"] Jun 15 03:18:28.437208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437148 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp"] Jun 15 03:18:28.437208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf"] Jun 15 03:18:28.437208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437188 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wl7rh"] Jun 15 03:18:28.437208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437206 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7"] Jun 15 03:18:28.437491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437224 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg"] Jun 15 03:18:28.437491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5btpk"] Jun 15 03:18:28.437491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437265 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-jv7nv"] Jun 15 03:18:28.437491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437288 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bd986dc6-w8m6k"] Jun 15 03:18:28.437491 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.437028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.439149 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.439131 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 03:18:28.439406 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.439387 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 03:18:28.439534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.439515 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvrpc\"" Jun 15 03:18:28.439534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.439526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 03:18:28.507994 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.507974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4875eebb-e655-4711-9650-01eedaf5ce3c-serving-cert\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.508100 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-certificates\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.508100 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4875eebb-e655-4711-9650-01eedaf5ce3c-snapshots\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.508100 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpk2w\" (UniqueName: \"kubernetes.io/projected/6a660f48-a8f1-4920-8aa3-003554456b23-kube-api-access-gpk2w\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.508100 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4875eebb-e655-4711-9650-01eedaf5ce3c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.508308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508142 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:28.508308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50d27669-d4f9-4b8d-b294-bb8701250ae8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.508308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c99f55-bfb1-4e5c-bc36-77328f36133e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.508308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6c99f55-bfb1-4e5c-bc36-77328f36133e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.508308 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhqs\" (UniqueName: \"kubernetes.io/projected/7fdcd33c-814c-472d-a645-e48e8ab2733e-kube-api-access-jqhqs\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/476951b2-68d4-494b-b9f4-7151eb1287c0-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a660f48-a8f1-4920-8aa3-003554456b23-config\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbsfq\" (UniqueName: \"kubernetes.io/projected/ddfbf611-621e-4781-8d8b-5039d88eb99b-kube-api-access-wbsfq\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzvtv\" (UniqueName: \"kubernetes.io/projected/a6c99f55-bfb1-4e5c-bc36-77328f36133e-kube-api-access-vzvtv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-image-registry-private-configuration\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.508487 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a55324fd-0b52-4171-a3cf-e3bd800c8b27-nginx-conf\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4875eebb-e655-4711-9650-01eedaf5ce3c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50d27669-d4f9-4b8d-b294-bb8701250ae8-config\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a660f48-a8f1-4920-8aa3-003554456b23-trusted-ca\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwmf\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-kube-api-access-2pwmf\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b353ecf-65d4-4f9e-8741-13aa18442556-ca-trust-extracted\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4875eebb-e655-4711-9650-01eedaf5ce3c-tmp\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmb7m\" (UniqueName: \"kubernetes.io/projected/50d27669-d4f9-4b8d-b294-bb8701250ae8-kube-api-access-cmb7m\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86cxc\" (UniqueName: \"kubernetes.io/projected/476951b2-68d4-494b-b9f4-7151eb1287c0-kube-api-access-86cxc\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.508736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c577b\" (UniqueName: \"kubernetes.io/projected/4875eebb-e655-4711-9650-01eedaf5ce3c-kube-api-access-c577b\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508746 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddfbf611-621e-4781-8d8b-5039d88eb99b-tmp-dir\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-installation-pull-secrets\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-bound-sa-token\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508793 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqpp\" (UniqueName: \"kubernetes.io/projected/0ad23080-f47a-4591-b985-6d8af588b9d7-kube-api-access-6tqpp\") pod \"volume-data-source-validator-bd4ccd799-4sffg\" (UID: \"0ad23080-f47a-4591-b985-6d8af588b9d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddfbf611-621e-4781-8d8b-5039d88eb99b-config-volume\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-trusted-ca\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.509084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.508839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a660f48-a8f1-4920-8aa3-003554456b23-serving-cert\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.609448 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4875eebb-e655-4711-9650-01eedaf5ce3c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.609600 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e491e7cd-4a61-448e-8494-57516ef4085c-cert\") pod \"ingress-canary-wl7rh\" (UID: \"e491e7cd-4a61-448e-8494-57516ef4085c\") " pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.609600 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:28.609600 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609518 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfsg8\" (UniqueName: \"kubernetes.io/projected/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-kube-api-access-wfsg8\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.609783 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.609607 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 03:18:28.609783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50d27669-d4f9-4b8d-b294-bb8701250ae8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.609783 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.609680 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert podName:a55324fd-0b52-4171-a3cf-e3bd800c8b27 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.109661944 +0000 UTC m=+35.584597384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-jv7nv" (UID: "a55324fd-0b52-4171-a3cf-e3bd800c8b27") : secret "networking-console-plugin-cert" not found Jun 15 03:18:28.609783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c99f55-bfb1-4e5c-bc36-77328f36133e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.609783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6c99f55-bfb1-4e5c-bc36-77328f36133e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.609783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609769 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609797 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhqs\" (UniqueName: \"kubernetes.io/projected/7fdcd33c-814c-472d-a645-e48e8ab2733e-kube-api-access-jqhqs\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/476951b2-68d4-494b-b9f4-7151eb1287c0-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a660f48-a8f1-4920-8aa3-003554456b23-config\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.609975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbsfq\" (UniqueName: \"kubernetes.io/projected/ddfbf611-621e-4781-8d8b-5039d88eb99b-kube-api-access-wbsfq\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzvtv\" (UniqueName: \"kubernetes.io/projected/a6c99f55-bfb1-4e5c-bc36-77328f36133e-kube-api-access-vzvtv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-image-registry-private-configuration\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a55324fd-0b52-4171-a3cf-e3bd800c8b27-nginx-conf\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:28.610118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4875eebb-e655-4711-9650-01eedaf5ce3c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50d27669-d4f9-4b8d-b294-bb8701250ae8-config\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a660f48-a8f1-4920-8aa3-003554456b23-trusted-ca\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-stats-auth\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwmf\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-kube-api-access-2pwmf\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b353ecf-65d4-4f9e-8741-13aa18442556-ca-trust-extracted\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610280 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610344 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls podName:476951b2-68d4-494b-b9f4-7151eb1287c0 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.11032777 +0000 UTC m=+35.585263205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kmgvd" (UID: "476951b2-68d4-494b-b9f4-7151eb1287c0") : secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610367 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a6c99f55-bfb1-4e5c-bc36-77328f36133e-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4875eebb-e655-4711-9650-01eedaf5ce3c-tmp\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610441 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610517 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls podName:ddfbf611-621e-4781-8d8b-5039d88eb99b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.110500896 +0000 UTC m=+35.585436354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls") pod "dns-default-5btpk" (UID: "ddfbf611-621e-4781-8d8b-5039d88eb99b") : secret "dns-default-metrics-tls" not found Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4875eebb-e655-4711-9650-01eedaf5ce3c-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.610631 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610587 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610631 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls podName:7fdcd33c-814c-472d-a645-e48e8ab2733e nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.110616754 +0000 UTC m=+35.585552187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls") pod "cluster-samples-operator-9547488fd-78tmp" (UID: "7fdcd33c-814c-472d-a645-e48e8ab2733e") : secret "samples-operator-tls" not found Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmb7m\" (UniqueName: \"kubernetes.io/projected/50d27669-d4f9-4b8d-b294-bb8701250ae8-kube-api-access-cmb7m\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610671 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86cxc\" (UniqueName: \"kubernetes.io/projected/476951b2-68d4-494b-b9f4-7151eb1287c0-kube-api-access-86cxc\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc4cv\" (UniqueName: \"kubernetes.io/projected/95a6ef96-6650-4aec-a37c-0e1916e7a14d-kube-api-access-bc4cv\") pod \"network-check-source-6947749cfc-b2qwf\" (UID: \"95a6ef96-6650-4aec-a37c-0e1916e7a14d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610725 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610740 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757c745fb4-8585r: secret "image-registry-tls" not found Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c577b\" (UniqueName: \"kubernetes.io/projected/4875eebb-e655-4711-9650-01eedaf5ce3c-kube-api-access-c577b\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddfbf611-621e-4781-8d8b-5039d88eb99b-tmp-dir\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.610793 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls podName:3b353ecf-65d4-4f9e-8741-13aa18442556 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.110777401 +0000 UTC m=+35.585712838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls") pod "image-registry-757c745fb4-8585r" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556") : secret "image-registry-tls" not found Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-installation-pull-secrets\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-bound-sa-token\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqpp\" (UniqueName: \"kubernetes.io/projected/0ad23080-f47a-4591-b985-6d8af588b9d7-kube-api-access-6tqpp\") pod \"volume-data-source-validator-bd4ccd799-4sffg\" (UID: \"0ad23080-f47a-4591-b985-6d8af588b9d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.610983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddfbf611-621e-4781-8d8b-5039d88eb99b-config-volume\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.611498 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/476951b2-68d4-494b-b9f4-7151eb1287c0-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-trusted-ca\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a660f48-a8f1-4920-8aa3-003554456b23-serving-cert\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-default-certificate\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611111 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ddfbf611-621e-4781-8d8b-5039d88eb99b-tmp-dir\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a55324fd-0b52-4171-a3cf-e3bd800c8b27-nginx-conf\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4875eebb-e655-4711-9650-01eedaf5ce3c-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b353ecf-65d4-4f9e-8741-13aa18442556-ca-trust-extracted\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.612305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-trusted-ca\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.612704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.611117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4875eebb-e655-4711-9650-01eedaf5ce3c-serving-cert\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.612704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.612567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-certificates\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.612704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.612612 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpbfx\" (UniqueName: \"kubernetes.io/projected/e491e7cd-4a61-448e-8494-57516ef4085c-kube-api-access-rpbfx\") pod \"ingress-canary-wl7rh\" (UID: \"e491e7cd-4a61-448e-8494-57516ef4085c\") " pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.612704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.612650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4875eebb-e655-4711-9650-01eedaf5ce3c-snapshots\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.612704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.612679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpk2w\" (UniqueName: \"kubernetes.io/projected/6a660f48-a8f1-4920-8aa3-003554456b23-kube-api-access-gpk2w\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.612968 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.612757 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/50d27669-d4f9-4b8d-b294-bb8701250ae8-config\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.613849 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.613055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4875eebb-e655-4711-9650-01eedaf5ce3c-tmp\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.613849 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.613472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-certificates\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.613849 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.613733 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ddfbf611-621e-4781-8d8b-5039d88eb99b-config-volume\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.613849 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.613771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a660f48-a8f1-4920-8aa3-003554456b23-config\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.614135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.614011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4875eebb-e655-4711-9650-01eedaf5ce3c-snapshots\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.614135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.614016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a660f48-a8f1-4920-8aa3-003554456b23-trusted-ca\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.614992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.614923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/50d27669-d4f9-4b8d-b294-bb8701250ae8-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.614992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.614976 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4875eebb-e655-4711-9650-01eedaf5ce3c-serving-cert\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.615288 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.615255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a6c99f55-bfb1-4e5c-bc36-77328f36133e-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.616117 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.615720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-image-registry-private-configuration\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.616117 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.616035 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a660f48-a8f1-4920-8aa3-003554456b23-serving-cert\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.616711 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.616690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-installation-pull-secrets\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.619493 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.619122 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmb7m\" (UniqueName: \"kubernetes.io/projected/50d27669-d4f9-4b8d-b294-bb8701250ae8-kube-api-access-cmb7m\") pod \"service-ca-operator-7ccbfd59dc-7nnt7\" (UID: \"50d27669-d4f9-4b8d-b294-bb8701250ae8\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.619493 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.619150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhqs\" (UniqueName: \"kubernetes.io/projected/7fdcd33c-814c-472d-a645-e48e8ab2733e-kube-api-access-jqhqs\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:28.620207 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.620181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzvtv\" (UniqueName: \"kubernetes.io/projected/a6c99f55-bfb1-4e5c-bc36-77328f36133e-kube-api-access-vzvtv\") pod \"kube-storage-version-migrator-operator-7c578b78fc-274n7\" (UID: \"a6c99f55-bfb1-4e5c-bc36-77328f36133e\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.622031 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.622002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c577b\" (UniqueName: \"kubernetes.io/projected/4875eebb-e655-4711-9650-01eedaf5ce3c-kube-api-access-c577b\") pod \"insights-operator-5bbd86d6bd-dc2m4\" (UID: \"4875eebb-e655-4711-9650-01eedaf5ce3c\") " pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.626356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.622193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwmf\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-kube-api-access-2pwmf\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.626356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.622519 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbsfq\" (UniqueName: \"kubernetes.io/projected/ddfbf611-621e-4781-8d8b-5039d88eb99b-kube-api-access-wbsfq\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:28.626356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.623478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86cxc\" (UniqueName: \"kubernetes.io/projected/476951b2-68d4-494b-b9f4-7151eb1287c0-kube-api-access-86cxc\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:28.626356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.623840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqpp\" (UniqueName: \"kubernetes.io/projected/0ad23080-f47a-4591-b985-6d8af588b9d7-kube-api-access-6tqpp\") pod \"volume-data-source-validator-bd4ccd799-4sffg\" (UID: \"0ad23080-f47a-4591-b985-6d8af588b9d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" Jun 15 03:18:28.627425 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.627402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-bound-sa-token\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:28.628788 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.628760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpk2w\" (UniqueName: \"kubernetes.io/projected/6a660f48-a8f1-4920-8aa3-003554456b23-kube-api-access-gpk2w\") pod \"console-operator-5dbbb5d744-b55b8\" (UID: \"6a660f48-a8f1-4920-8aa3-003554456b23\") " pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.706747 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.706703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" Jun 15 03:18:28.713089 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-stats-auth\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.713203 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc4cv\" (UniqueName: \"kubernetes.io/projected/95a6ef96-6650-4aec-a37c-0e1916e7a14d-kube-api-access-bc4cv\") pod \"network-check-source-6947749cfc-b2qwf\" (UID: \"95a6ef96-6650-4aec-a37c-0e1916e7a14d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" Jun 15 03:18:28.713203 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.713203 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-default-certificate\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.713328 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpbfx\" (UniqueName: \"kubernetes.io/projected/e491e7cd-4a61-448e-8494-57516ef4085c-kube-api-access-rpbfx\") pod \"ingress-canary-wl7rh\" (UID: \"e491e7cd-4a61-448e-8494-57516ef4085c\") " pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.713328 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e491e7cd-4a61-448e-8494-57516ef4085c-cert\") pod \"ingress-canary-wl7rh\" (UID: \"e491e7cd-4a61-448e-8494-57516ef4085c\") " pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.713328 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfsg8\" (UniqueName: \"kubernetes.io/projected/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-kube-api-access-wfsg8\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.713489 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.713337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.713551 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.713527 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 03:18:28.713619 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.713606 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.213590433 +0000 UTC m=+35.688525879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : secret "router-metrics-certs-default" not found Jun 15 03:18:28.714052 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:28.714017 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:29.213995686 +0000 UTC m=+35.688931137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : configmap references non-existent config key: service-ca.crt Jun 15 03:18:28.716140 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.716114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-stats-auth\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.716376 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.716356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-default-certificate\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.716653 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.716636 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e491e7cd-4a61-448e-8494-57516ef4085c-cert\") pod \"ingress-canary-wl7rh\" (UID: \"e491e7cd-4a61-448e-8494-57516ef4085c\") " pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.723962 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.723920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfsg8\" (UniqueName: \"kubernetes.io/projected/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-kube-api-access-wfsg8\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:28.724094 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.724055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpbfx\" (UniqueName: \"kubernetes.io/projected/e491e7cd-4a61-448e-8494-57516ef4085c-kube-api-access-rpbfx\") pod \"ingress-canary-wl7rh\" (UID: \"e491e7cd-4a61-448e-8494-57516ef4085c\") " pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.724407 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.724385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc4cv\" (UniqueName: \"kubernetes.io/projected/95a6ef96-6650-4aec-a37c-0e1916e7a14d-kube-api-access-bc4cv\") pod \"network-check-source-6947749cfc-b2qwf\" (UID: \"95a6ef96-6650-4aec-a37c-0e1916e7a14d\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" Jun 15 03:18:28.729034 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.729000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" Jun 15 03:18:28.737818 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.737796 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" Jun 15 03:18:28.745249 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.745180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:28.768729 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.768548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" Jun 15 03:18:28.782420 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.782016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" Jun 15 03:18:28.791887 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.790267 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wl7rh" Jun 15 03:18:28.940432 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.940316 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-dc2m4"] Jun 15 03:18:28.950187 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:28.950154 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4875eebb_e655_4711_9650_01eedaf5ce3c.slice/crio-103d704a2bd1b1fbe4e9e5e0d4403b00b3a1c67ea3486da1bf9844d950ed20bd WatchSource:0}: Error finding container 103d704a2bd1b1fbe4e9e5e0d4403b00b3a1c67ea3486da1bf9844d950ed20bd: Status 404 returned error can't find the container with id 103d704a2bd1b1fbe4e9e5e0d4403b00b3a1c67ea3486da1bf9844d950ed20bd Jun 15 03:18:28.973735 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.973664 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg"] Jun 15 03:18:28.980690 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:28.980652 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ad23080_f47a_4591_b985_6d8af588b9d7.slice/crio-efd41786fd9bf92bde91811247802e39649ed5c65e146f09b4ceebe8fa20f866 WatchSource:0}: Error finding container efd41786fd9bf92bde91811247802e39649ed5c65e146f09b4ceebe8fa20f866: Status 404 returned error can't find the container with id efd41786fd9bf92bde91811247802e39649ed5c65e146f09b4ceebe8fa20f866 Jun 15 03:18:28.989246 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.988005 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7"] Jun 15 03:18:28.991716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:28.991072 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-b55b8"] Jun 15 03:18:28.995311 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:28.995136 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d27669_d4f9_4b8d_b294_bb8701250ae8.slice/crio-6b3e0e82b6dc67453e4d065d51a5a8776d5a1729346900a27f39798233f9ba32 WatchSource:0}: Error finding container 6b3e0e82b6dc67453e4d065d51a5a8776d5a1729346900a27f39798233f9ba32: Status 404 returned error can't find the container with id 6b3e0e82b6dc67453e4d065d51a5a8776d5a1729346900a27f39798233f9ba32 Jun 15 03:18:28.995636 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:28.995602 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a660f48_a8f1_4920_8aa3_003554456b23.slice/crio-fe728e51b62b317e073c6697a2c9db372736852ae9c68e506acd50a494afce00 WatchSource:0}: Error finding container fe728e51b62b317e073c6697a2c9db372736852ae9c68e506acd50a494afce00: Status 404 returned error can't find the container with id fe728e51b62b317e073c6697a2c9db372736852ae9c68e506acd50a494afce00 Jun 15 03:18:29.025268 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.025239 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7"] Jun 15 03:18:29.027946 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.027910 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf"] Jun 15 03:18:29.030378 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:29.030353 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c99f55_bfb1_4e5c_bc36_77328f36133e.slice/crio-5e945fa22f5b9971f114744e0a40ab782ac0d45a9a13439538bd1ce2f9d80626 WatchSource:0}: Error finding container 5e945fa22f5b9971f114744e0a40ab782ac0d45a9a13439538bd1ce2f9d80626: Status 404 returned error can't find the container with id 5e945fa22f5b9971f114744e0a40ab782ac0d45a9a13439538bd1ce2f9d80626 Jun 15 03:18:29.031640 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:29.031452 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95a6ef96_6650_4aec_a37c_0e1916e7a14d.slice/crio-9314259f10e3d7071b536fc9fd9ed68a4a8a025823f051b86bfa67897326b2da WatchSource:0}: Error finding container 9314259f10e3d7071b536fc9fd9ed68a4a8a025823f051b86bfa67897326b2da: Status 404 returned error can't find the container with id 9314259f10e3d7071b536fc9fd9ed68a4a8a025823f051b86bfa67897326b2da Jun 15 03:18:29.039063 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.039042 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wl7rh"] Jun 15 03:18:29.045643 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:29.045619 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode491e7cd_4a61_448e_8494_57516ef4085c.slice/crio-698683d77d3fb601082898d10e3bb47daa477d484130d3c964d78ed2937ca1b9 WatchSource:0}: Error finding container 698683d77d3fb601082898d10e3bb47daa477d484130d3c964d78ed2937ca1b9: Status 404 returned error can't find the container with id 698683d77d3fb601082898d10e3bb47daa477d484130d3c964d78ed2937ca1b9 Jun 15 03:18:29.117694 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.117627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:29.117694 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.117688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:29.117865 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.117770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:29.117865 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.117798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:29.117865 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117804 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 03:18:29.117865 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.117839 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117870 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert podName:a55324fd-0b52-4171-a3cf-e3bd800c8b27 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.117852048 +0000 UTC m=+36.592787500 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-jv7nv" (UID: "a55324fd-0b52-4171-a3cf-e3bd800c8b27") : secret "networking-console-plugin-cert" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117879 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117893 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757c745fb4-8585r: secret "image-registry-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117880 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117924 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117943 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls podName:3b353ecf-65d4-4f9e-8741-13aa18442556 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.117917679 +0000 UTC m=+36.592853118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls") pod "image-registry-757c745fb4-8585r" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556") : secret "image-registry-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.117983 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.118001 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls podName:476951b2-68d4-494b-b9f4-7151eb1287c0 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.117985296 +0000 UTC m=+36.592920728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kmgvd" (UID: "476951b2-68d4-494b-b9f4-7151eb1287c0") : secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.118014 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls podName:7fdcd33c-814c-472d-a645-e48e8ab2733e nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.118008232 +0000 UTC m=+36.592943663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls") pod "cluster-samples-operator-9547488fd-78tmp" (UID: "7fdcd33c-814c-472d-a645-e48e8ab2733e") : secret "samples-operator-tls" not found Jun 15 03:18:29.118099 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.118029 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls podName:ddfbf611-621e-4781-8d8b-5039d88eb99b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.118022528 +0000 UTC m=+36.592957961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls") pod "dns-default-5btpk" (UID: "ddfbf611-621e-4781-8d8b-5039d88eb99b") : secret "dns-default-metrics-tls" not found Jun 15 03:18:29.218533 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.218500 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:29.218692 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.218673 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 03:18:29.218769 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.218757 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.218737479 +0000 UTC m=+36.693672917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : secret "router-metrics-certs-default" not found Jun 15 03:18:29.218840 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.218824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:29.219009 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:29.218995 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:30.218982002 +0000 UTC m=+36.693917440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : configmap references non-existent config key: service-ca.crt Jun 15 03:18:29.235204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.235173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wl7rh" event={"ID":"e491e7cd-4a61-448e-8494-57516ef4085c","Type":"ContainerStarted","Data":"698683d77d3fb601082898d10e3bb47daa477d484130d3c964d78ed2937ca1b9"} Jun 15 03:18:29.236462 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.236433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" event={"ID":"95a6ef96-6650-4aec-a37c-0e1916e7a14d","Type":"ContainerStarted","Data":"9314259f10e3d7071b536fc9fd9ed68a4a8a025823f051b86bfa67897326b2da"} Jun 15 03:18:29.237611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.237551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" event={"ID":"50d27669-d4f9-4b8d-b294-bb8701250ae8","Type":"ContainerStarted","Data":"6b3e0e82b6dc67453e4d065d51a5a8776d5a1729346900a27f39798233f9ba32"} Jun 15 03:18:29.238775 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.238751 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" event={"ID":"4875eebb-e655-4711-9650-01eedaf5ce3c","Type":"ContainerStarted","Data":"103d704a2bd1b1fbe4e9e5e0d4403b00b3a1c67ea3486da1bf9844d950ed20bd"} Jun 15 03:18:29.240028 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.240008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" event={"ID":"6a660f48-a8f1-4920-8aa3-003554456b23","Type":"ContainerStarted","Data":"fe728e51b62b317e073c6697a2c9db372736852ae9c68e506acd50a494afce00"} Jun 15 03:18:29.241125 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.241107 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" event={"ID":"a6c99f55-bfb1-4e5c-bc36-77328f36133e","Type":"ContainerStarted","Data":"5e945fa22f5b9971f114744e0a40ab782ac0d45a9a13439538bd1ce2f9d80626"} Jun 15 03:18:29.242261 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:29.242234 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" event={"ID":"0ad23080-f47a-4591-b985-6d8af588b9d7","Type":"ContainerStarted","Data":"efd41786fd9bf92bde91811247802e39649ed5c65e146f09b4ceebe8fa20f866"} Jun 15 03:18:30.012920 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.011594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:30.012920 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.012059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:30.012920 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.012464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:30.015089 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.014255 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9frqx\"" Jun 15 03:18:30.015089 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.014524 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 03:18:30.015911 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.015636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 03:18:30.017035 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.016859 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbt26\"" Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.129094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.129143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.129192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.129278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.129336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.129512 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.129587 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls podName:476951b2-68d4-494b-b9f4-7151eb1287c0 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.129553332 +0000 UTC m=+38.604488768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kmgvd" (UID: "476951b2-68d4-494b-b9f4-7151eb1287c0") : secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.129997 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130012 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757c745fb4-8585r: secret "image-registry-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130068 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls podName:3b353ecf-65d4-4f9e-8741-13aa18442556 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.13004254 +0000 UTC m=+38.604977979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls") pod "image-registry-757c745fb4-8585r" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556") : secret "image-registry-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130128 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130156 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls podName:ddfbf611-621e-4781-8d8b-5039d88eb99b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.130146817 +0000 UTC m=+38.605082253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls") pod "dns-default-5btpk" (UID: "ddfbf611-621e-4781-8d8b-5039d88eb99b") : secret "dns-default-metrics-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130208 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130239 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls podName:7fdcd33c-814c-472d-a645-e48e8ab2733e nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.130228308 +0000 UTC m=+38.605163756 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls") pod "cluster-samples-operator-9547488fd-78tmp" (UID: "7fdcd33c-814c-472d-a645-e48e8ab2733e") : secret "samples-operator-tls" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130292 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 03:18:30.130363 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.130320 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert podName:a55324fd-0b52-4171-a3cf-e3bd800c8b27 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.13031134 +0000 UTC m=+38.605246774 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-jv7nv" (UID: "a55324fd-0b52-4171-a3cf-e3bd800c8b27") : secret "networking-console-plugin-cert" not found Jun 15 03:18:30.230484 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.230429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:30.230645 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:30.230549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:30.230756 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.230739 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 03:18:30.230820 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.230809 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.230790422 +0000 UTC m=+38.705725872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : secret "router-metrics-certs-default" not found Jun 15 03:18:30.230902 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:30.230889 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:32.230878325 +0000 UTC m=+38.705813773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : configmap references non-existent config key: service-ca.crt Jun 15 03:18:32.156023 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.155981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.156033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156162 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156173 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156195 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757c745fb4-8585r: secret "image-registry-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.156227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156254 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls podName:3b353ecf-65d4-4f9e-8741-13aa18442556 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.156234862 +0000 UTC m=+42.631170301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls") pod "image-registry-757c745fb4-8585r" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556") : secret "image-registry-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156277 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls podName:ddfbf611-621e-4781-8d8b-5039d88eb99b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.156268847 +0000 UTC m=+42.631204279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls") pod "dns-default-5btpk" (UID: "ddfbf611-621e-4781-8d8b-5039d88eb99b") : secret "dns-default-metrics-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156313 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156366 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls podName:7fdcd33c-814c-472d-a645-e48e8ab2733e nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.156352061 +0000 UTC m=+42.631287499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls") pod "cluster-samples-operator-9547488fd-78tmp" (UID: "7fdcd33c-814c-472d-a645-e48e8ab2733e") : secret "samples-operator-tls" not found Jun 15 03:18:32.156427 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.156398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:32.156847 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.156435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:32.156847 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156569 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 03:18:32.156847 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156583 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:32.156847 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156609 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert podName:a55324fd-0b52-4171-a3cf-e3bd800c8b27 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.156595883 +0000 UTC m=+42.631531318 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-jv7nv" (UID: "a55324fd-0b52-4171-a3cf-e3bd800c8b27") : secret "networking-console-plugin-cert" not found Jun 15 03:18:32.156847 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.156626 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls podName:476951b2-68d4-494b-b9f4-7151eb1287c0 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.156614411 +0000 UTC m=+42.631549867 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kmgvd" (UID: "476951b2-68d4-494b-b9f4-7151eb1287c0") : secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:32.257639 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.257563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:32.257783 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:32.257677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:32.257783 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.257748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.257722968 +0000 UTC m=+42.732658406 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : configmap references non-existent config key: service-ca.crt Jun 15 03:18:32.257911 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.257818 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 03:18:32.257911 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:32.257878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:36.257858873 +0000 UTC m=+42.732794311 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : secret "router-metrics-certs-default" not found Jun 15 03:18:36.193330 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.193283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.193344 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.193413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.193437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193458 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.193479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193516 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193541 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193554 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert podName:a55324fd-0b52-4171-a3cf-e3bd800c8b27 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.193523262 +0000 UTC m=+50.668458717 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-jv7nv" (UID: "a55324fd-0b52-4171-a3cf-e3bd800c8b27") : secret "networking-console-plugin-cert" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193559 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757c745fb4-8585r: secret "image-registry-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193578 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls podName:476951b2-68d4-494b-b9f4-7151eb1287c0 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.193567677 +0000 UTC m=+50.668503113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kmgvd" (UID: "476951b2-68d4-494b-b9f4-7151eb1287c0") : secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193596 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193638 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193607 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls podName:3b353ecf-65d4-4f9e-8741-13aa18442556 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.193590126 +0000 UTC m=+50.668525580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls") pod "image-registry-757c745fb4-8585r" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556") : secret "image-registry-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193738 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls podName:ddfbf611-621e-4781-8d8b-5039d88eb99b nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.19368232 +0000 UTC m=+50.668617765 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls") pod "dns-default-5btpk" (UID: "ddfbf611-621e-4781-8d8b-5039d88eb99b") : secret "dns-default-metrics-tls" not found Jun 15 03:18:36.193800 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.193771 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls podName:7fdcd33c-814c-472d-a645-e48e8ab2733e nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.193759512 +0000 UTC m=+50.668694949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls") pod "cluster-samples-operator-9547488fd-78tmp" (UID: "7fdcd33c-814c-472d-a645-e48e8ab2733e") : secret "samples-operator-tls" not found Jun 15 03:18:36.294706 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.294673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:36.294897 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:36.294785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:36.294987 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.294914 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.29489478 +0000 UTC m=+50.769830224 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : configmap references non-existent config key: service-ca.crt Jun 15 03:18:36.294987 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.294926 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 03:18:36.294987 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:36.294979 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:44.294970371 +0000 UTC m=+50.769905806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : secret "router-metrics-certs-default" not found Jun 15 03:18:39.282008 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.281966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" event={"ID":"50d27669-d4f9-4b8d-b294-bb8701250ae8","Type":"ContainerStarted","Data":"fa32c360b4e9471b4c29c5532379d2927056be8c1eef66a534707aeb2e41ca32"} Jun 15 03:18:39.283655 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.283629 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" event={"ID":"4875eebb-e655-4711-9650-01eedaf5ce3c","Type":"ContainerStarted","Data":"a888b46c3c297e280980db4c34bb814f7c33a0e176cee7d0800a8655d5d8d18e"} Jun 15 03:18:39.285430 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.285403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/0.log" Jun 15 03:18:39.285534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.285444 2562 generic.go:356] "Generic (PLEG): container finished" podID="6a660f48-a8f1-4920-8aa3-003554456b23" containerID="869075ce0379e43a0a8028201e6d1142ae29aa214389ebe3a2d86bd502ee191f" exitCode=255 Jun 15 03:18:39.285534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.285519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" event={"ID":"6a660f48-a8f1-4920-8aa3-003554456b23","Type":"ContainerDied","Data":"869075ce0379e43a0a8028201e6d1142ae29aa214389ebe3a2d86bd502ee191f"} Jun 15 03:18:39.285704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.285686 2562 scope.go:117] "RemoveContainer" containerID="869075ce0379e43a0a8028201e6d1142ae29aa214389ebe3a2d86bd502ee191f" Jun 15 03:18:39.287175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.287146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" event={"ID":"a6c99f55-bfb1-4e5c-bc36-77328f36133e","Type":"ContainerStarted","Data":"b54abf71628af001d088e75cdcdb6a9e3a45b71778110feff49b091a3749be6a"} Jun 15 03:18:39.288742 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.288696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" event={"ID":"0ad23080-f47a-4591-b985-6d8af588b9d7","Type":"ContainerStarted","Data":"0b252131f5e8ac8708f4ed085dc128e342ac9fc4c0cfd0a7e8597c34b28081ff"} Jun 15 03:18:39.290298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.290266 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wl7rh" event={"ID":"e491e7cd-4a61-448e-8494-57516ef4085c","Type":"ContainerStarted","Data":"14e38caaa8cca2f9a69c92ba6c8820f3aebab3ef099a78bc17d5adcf617044a8"} Jun 15 03:18:39.291737 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.291716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" event={"ID":"95a6ef96-6650-4aec-a37c-0e1916e7a14d","Type":"ContainerStarted","Data":"d312338e05fc16e6951890b13a7308486eb244da69aad5f791f34d2367abe767"} Jun 15 03:18:39.294552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.294528 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fa42666-b6c2-4e6e-800a-a4262affe3e9" containerID="b6bf171e3f3856c97ee3172b4ab33b3afc48a74d05608e20718b5b29ae8d6948" exitCode=0 Jun 15 03:18:39.294636 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.294566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerDied","Data":"b6bf171e3f3856c97ee3172b4ab33b3afc48a74d05608e20718b5b29ae8d6948"} Jun 15 03:18:39.298900 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.298855 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" podStartSLOduration=19.092282748 podStartE2EDuration="28.298838506s" totalImagesPullingTime="9.206555758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.297741943 +0000 UTC m=+45.772677396" watchObservedRunningTime="2026-06-15 03:18:39.298838506 +0000 UTC m=+45.773773963" Jun 15 03:18:39.356565 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.356514 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-4sffg" podStartSLOduration=19.414961671 podStartE2EDuration="28.35649231s" totalImagesPullingTime="8.941530639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.339158911 +0000 UTC m=+45.814094365" watchObservedRunningTime="2026-06-15 03:18:39.35649231 +0000 UTC m=+45.831427765" Jun 15 03:18:39.387544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.387489 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" podStartSLOduration=19.217542085 podStartE2EDuration="28.387469503s" totalImagesPullingTime="9.169927418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.358134149 +0000 UTC m=+45.833069603" watchObservedRunningTime="2026-06-15 03:18:39.387469503 +0000 UTC m=+45.862404957" Jun 15 03:18:39.408475 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.408420 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wl7rh" podStartSLOduration=2.251260449 podStartE2EDuration="11.408399635s" totalImagesPullingTime="9.157139186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.406917677 +0000 UTC m=+45.881853133" watchObservedRunningTime="2026-06-15 03:18:39.408399635 +0000 UTC m=+45.883335085" Jun 15 03:18:39.422980 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.422916 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" podStartSLOduration=19.173965375 podStartE2EDuration="28.422900337s" totalImagesPullingTime="9.248934962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.422363334 +0000 UTC m=+45.897298791" watchObservedRunningTime="2026-06-15 03:18:39.422900337 +0000 UTC m=+45.897835791" Jun 15 03:18:39.706819 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.703987 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-b2qwf" podStartSLOduration=19.521562421 podStartE2EDuration="28.703962438s" totalImagesPullingTime="9.182400017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:39.443444216 +0000 UTC m=+45.918379671" watchObservedRunningTime="2026-06-15 03:18:39.703962438 +0000 UTC m=+46.178897892" Jun 15 03:18:39.706819 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.705640 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qjzv8"] Jun 15 03:18:39.720749 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.720717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.721804 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.721777 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qjzv8"] Jun 15 03:18:39.723196 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.723012 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 03:18:39.723196 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.723082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 03:18:39.723196 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.723166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fl546\"" Jun 15 03:18:39.828840 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.828758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.829019 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.828864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7hlk\" (UniqueName: \"kubernetes.io/projected/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-api-access-d7hlk\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.829019 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.828986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50e4574-40e3-4b2e-b9a9-b8b973279d77-data-volume\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.829133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.829018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.829133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.829090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b50e4574-40e3-4b2e-b9a9-b8b973279d77-crio-socket\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.929716 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.929686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7hlk\" (UniqueName: \"kubernetes.io/projected/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-api-access-d7hlk\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.929863 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.929753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50e4574-40e3-4b2e-b9a9-b8b973279d77-data-volume\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.929863 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.929783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.929863 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.929813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b50e4574-40e3-4b2e-b9a9-b8b973279d77-crio-socket\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.929863 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.929857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.930101 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:39.929929 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:39.930101 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:39.929980 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:39.930101 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:39.930010 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:40.429993971 +0000 UTC m=+46.904929424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:39.930101 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:39.930035 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:40.430017019 +0000 UTC m=+46.904952467 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : configmap "kube-rbac-proxy" not found Jun 15 03:18:39.930101 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.930069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b50e4574-40e3-4b2e-b9a9-b8b973279d77-crio-socket\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.930275 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.930151 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b50e4574-40e3-4b2e-b9a9-b8b973279d77-data-volume\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:39.938766 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:39.938747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7hlk\" (UniqueName: \"kubernetes.io/projected/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-api-access-d7hlk\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:40.299954 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.299899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:18:40.300426 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.300395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/0.log" Jun 15 03:18:40.300484 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.300426 2562 generic.go:356] "Generic (PLEG): container finished" podID="6a660f48-a8f1-4920-8aa3-003554456b23" containerID="c6366d1961166d461319cdcaf83e9237aab9d53ff72ed6e20aab61cb48b2b253" exitCode=255 Jun 15 03:18:40.300539 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.300517 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" event={"ID":"6a660f48-a8f1-4920-8aa3-003554456b23","Type":"ContainerDied","Data":"c6366d1961166d461319cdcaf83e9237aab9d53ff72ed6e20aab61cb48b2b253"} Jun 15 03:18:40.300590 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.300580 2562 scope.go:117] "RemoveContainer" containerID="869075ce0379e43a0a8028201e6d1142ae29aa214389ebe3a2d86bd502ee191f" Jun 15 03:18:40.300823 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.300802 2562 scope.go:117] "RemoveContainer" containerID="c6366d1961166d461319cdcaf83e9237aab9d53ff72ed6e20aab61cb48b2b253" Jun 15 03:18:40.301058 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:40.301034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-b55b8_openshift-console-operator(6a660f48-a8f1-4920-8aa3-003554456b23)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" podUID="6a660f48-a8f1-4920-8aa3-003554456b23" Jun 15 03:18:40.303922 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.303899 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fa42666-b6c2-4e6e-800a-a4262affe3e9" containerID="9620a49600fbd0aaba48a1c4cf12313084e7b72d8f98d86db87fee95460604a7" exitCode=0 Jun 15 03:18:40.304044 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.303988 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerDied","Data":"9620a49600fbd0aaba48a1c4cf12313084e7b72d8f98d86db87fee95460604a7"} Jun 15 03:18:40.436642 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.436613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:40.436753 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:40.436700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:40.436822 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:40.436801 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:40.436877 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:40.436835 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:40.436944 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:40.436878 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:41.436857126 +0000 UTC m=+47.911792575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : configmap "kube-rbac-proxy" not found Jun 15 03:18:40.436944 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:40.436900 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:41.436889239 +0000 UTC m=+47.911824670 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:41.309293 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.309261 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ql7z8_ef8418f2-cd72-4c95-906c-d234ad1e5445/dns-node-resolver/0.log" Jun 15 03:18:41.309701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.309322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:18:41.309701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.309621 2562 scope.go:117] "RemoveContainer" containerID="c6366d1961166d461319cdcaf83e9237aab9d53ff72ed6e20aab61cb48b2b253" Jun 15 03:18:41.309827 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:41.309805 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-b55b8_openshift-console-operator(6a660f48-a8f1-4920-8aa3-003554456b23)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" podUID="6a660f48-a8f1-4920-8aa3-003554456b23" Jun 15 03:18:41.313095 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.313072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" event={"ID":"2fa42666-b6c2-4e6e-800a-a4262affe3e9","Type":"ContainerStarted","Data":"babd00a5748e30e0563021a7cc241810593f5556d99e8ddb3b7a90753bf06b7f"} Jun 15 03:18:41.347601 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.347554 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kzb9f" podStartSLOduration=17.564456402 podStartE2EDuration="47.34754111s" totalImagesPullingTime="29.783084708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:18:41.346159589 +0000 UTC m=+47.821095046" watchObservedRunningTime="2026-06-15 03:18:41.34754111 +0000 UTC m=+47.822476564" Jun 15 03:18:41.446143 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.446115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:41.446331 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:41.446237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:41.446331 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:41.446245 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:41.446462 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:41.446331 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:43.446310479 +0000 UTC m=+49.921245912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : configmap "kube-rbac-proxy" not found Jun 15 03:18:41.446462 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:41.446358 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:41.446462 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:41.446395 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:43.446385179 +0000 UTC m=+49.921320617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:42.101651 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:42.101626 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dn248_629863d9-1ff0-47ce-bf85-38d078b40b36/node-ca/0.log" Jun 15 03:18:42.702807 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:42.702777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wl7rh_e491e7cd-4a61-448e-8494-57516ef4085c/serve-healthcheck-canary/0.log" Jun 15 03:18:43.464239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:43.464203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:43.464424 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:43.464264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:43.464424 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:43.464338 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 03:18:43.464424 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:43.464352 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:43.464424 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:43.464396 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:47.464384607 +0000 UTC m=+53.939320039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : configmap "kube-rbac-proxy" not found Jun 15 03:18:43.464424 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:43.464409 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:47.46440331 +0000 UTC m=+53.939338741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:44.273021 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.272984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.273043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.273116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.273144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273150 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273200 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273214 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273232 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-757c745fb4-8585r: secret "image-registry-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.273200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273212 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert podName:a55324fd-0b52-4171-a3cf-e3bd800c8b27 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.273195896 +0000 UTC m=+66.748131328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-jv7nv" (UID: "a55324fd-0b52-4171-a3cf-e3bd800c8b27") : secret "networking-console-plugin-cert" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273284 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls podName:3b353ecf-65d4-4f9e-8741-13aa18442556 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.273263853 +0000 UTC m=+66.748199289 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls") pod "image-registry-757c745fb4-8585r" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556") : secret "image-registry-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273291 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273299 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273302 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls podName:476951b2-68d4-494b-b9f4-7151eb1287c0 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.273293588 +0000 UTC m=+66.748229020 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-kmgvd" (UID: "476951b2-68d4-494b-b9f4-7151eb1287c0") : secret "cluster-monitoring-operator-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls podName:7fdcd33c-814c-472d-a645-e48e8ab2733e nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.273338375 +0000 UTC m=+66.748273814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls") pod "cluster-samples-operator-9547488fd-78tmp" (UID: "7fdcd33c-814c-472d-a645-e48e8ab2733e") : secret "samples-operator-tls" not found Jun 15 03:18:44.273472 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.273370 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls podName:ddfbf611-621e-4781-8d8b-5039d88eb99b nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.27336181 +0000 UTC m=+66.748297243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls") pod "dns-default-5btpk" (UID: "ddfbf611-621e-4781-8d8b-5039d88eb99b") : secret "dns-default-metrics-tls" not found Jun 15 03:18:44.373775 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.373746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:44.373964 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:44.373856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:18:44.373964 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.373887 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 03:18:44.373964 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.373956 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.373944407 +0000 UTC m=+66.848879853 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : configmap references non-existent config key: service-ca.crt Jun 15 03:18:44.374149 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:44.373970 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs podName:b4ff6f0d-4802-479f-a1d5-f5f6f42e0405 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:00.373964435 +0000 UTC m=+66.848899867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs") pod "router-default-66bd986dc6-w8m6k" (UID: "b4ff6f0d-4802-479f-a1d5-f5f6f42e0405") : secret "router-metrics-certs-default" not found Jun 15 03:18:47.498013 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:47.497978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:47.498544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:47.498034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:47.498544 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:47.498145 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 03:18:47.498544 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:47.498223 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls podName:b50e4574-40e3-4b2e-b9a9-b8b973279d77 nodeName:}" failed. No retries permitted until 2026-06-15 03:18:55.498202134 +0000 UTC m=+61.973137573 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qjzv8" (UID: "b50e4574-40e3-4b2e-b9a9-b8b973279d77") : secret "insights-runtime-extractor-tls" not found Jun 15 03:18:47.498544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:47.498474 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b50e4574-40e3-4b2e-b9a9-b8b973279d77-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:48.745609 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:48.745578 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:48.745978 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:48.745627 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:18:48.745978 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:48.745917 2562 scope.go:117] "RemoveContainer" containerID="c6366d1961166d461319cdcaf83e9237aab9d53ff72ed6e20aab61cb48b2b253" Jun 15 03:18:48.746112 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:18:48.746093 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-b55b8_openshift-console-operator(6a660f48-a8f1-4920-8aa3-003554456b23)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" podUID="6a660f48-a8f1-4920-8aa3-003554456b23" Jun 15 03:18:54.225539 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:54.225512 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-p5f9v" Jun 15 03:18:55.567373 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:55.567341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:55.569566 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:55.569543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b50e4574-40e3-4b2e-b9a9-b8b973279d77-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qjzv8\" (UID: \"b50e4574-40e3-4b2e-b9a9-b8b973279d77\") " pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:55.633564 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:55.633536 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fl546\"" Jun 15 03:18:55.642426 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:55.642409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qjzv8" Jun 15 03:18:55.768231 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:55.768199 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qjzv8"] Jun 15 03:18:55.770626 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:55.770599 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50e4574_40e3_4b2e_b9a9_b8b973279d77.slice/crio-8be6dd8fc3f6f6914cabd11a43fcdfd048d46a81c7d80caa5cd5a77f762ad42e WatchSource:0}: Error finding container 8be6dd8fc3f6f6914cabd11a43fcdfd048d46a81c7d80caa5cd5a77f762ad42e: Status 404 returned error can't find the container with id 8be6dd8fc3f6f6914cabd11a43fcdfd048d46a81c7d80caa5cd5a77f762ad42e Jun 15 03:18:56.365202 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:56.365148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qjzv8" event={"ID":"b50e4574-40e3-4b2e-b9a9-b8b973279d77","Type":"ContainerStarted","Data":"8be6dd8fc3f6f6914cabd11a43fcdfd048d46a81c7d80caa5cd5a77f762ad42e"} Jun 15 03:18:59.376239 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.376204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qjzv8" event={"ID":"b50e4574-40e3-4b2e-b9a9-b8b973279d77","Type":"ContainerStarted","Data":"095bf8cf9cf968338f0db50a0d63b86f5132b88a8ffe6be7e8119b6dfd9e21fe"} Jun 15 03:18:59.707246 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.707207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:59.707399 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.707260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:59.709621 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.709603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 03:18:59.709664 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.709640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 03:18:59.720540 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.720505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/50486edf-f3f6-4da6-bf76-65c1b6388548-metrics-certs\") pod \"network-metrics-daemon-bk8st\" (UID: \"50486edf-f3f6-4da6-bf76-65c1b6388548\") " pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:59.720684 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.720543 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/80a405e9-d122-4234-8d5b-7957e771d871-original-pull-secret\") pod \"global-pull-secret-syncer-8bp2g\" (UID: \"80a405e9-d122-4234-8d5b-7957e771d871\") " pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:59.732614 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.732589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8bp2g" Jun 15 03:18:59.757171 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.757139 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qbt26\"" Jun 15 03:18:59.765828 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.765808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bk8st" Jun 15 03:18:59.909047 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.908927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:59.911163 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.911143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzz6t\" (UniqueName: \"kubernetes.io/projected/71432268-0183-44a0-9869-2b8c1efd7b9f-kube-api-access-fzz6t\") pod \"network-check-target-hfvvs\" (UID: \"71432268-0183-44a0-9869-2b8c1efd7b9f\") " pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:18:59.914084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.914064 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8bp2g"] Jun 15 03:18:59.917010 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:59.916991 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a405e9_d122_4234_8d5b_7957e771d871.slice/crio-62e8d93767dc043e3cca7752d793129c05324037aa269f56516298a7e8911df9 WatchSource:0}: Error finding container 62e8d93767dc043e3cca7752d793129c05324037aa269f56516298a7e8911df9: Status 404 returned error can't find the container with id 62e8d93767dc043e3cca7752d793129c05324037aa269f56516298a7e8911df9 Jun 15 03:18:59.929793 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:18:59.929775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bk8st"] Jun 15 03:18:59.933286 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:18:59.933260 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50486edf_f3f6_4da6_bf76_65c1b6388548.slice/crio-bf47e45d82898730e95e2e0922d316c3f3858e09cefc041097a1ac694de48fdb WatchSource:0}: Error finding container bf47e45d82898730e95e2e0922d316c3f3858e09cefc041097a1ac694de48fdb: Status 404 returned error can't find the container with id bf47e45d82898730e95e2e0922d316c3f3858e09cefc041097a1ac694de48fdb Jun 15 03:19:00.048248 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.048186 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9frqx\"" Jun 15 03:19:00.056844 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.056829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:19:00.176610 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.176581 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfvvs"] Jun 15 03:19:00.179701 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:00.179678 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71432268_0183_44a0_9869_2b8c1efd7b9f.slice/crio-e7bda1f1c6c026baf1ac6d538c55a1ed04ab5e5355c7c9f3742b22ad17d62de1 WatchSource:0}: Error finding container e7bda1f1c6c026baf1ac6d538c55a1ed04ab5e5355c7c9f3742b22ad17d62de1: Status 404 returned error can't find the container with id e7bda1f1c6c026baf1ac6d538c55a1ed04ab5e5355c7c9f3742b22ad17d62de1 Jun 15 03:19:00.313298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.313232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:19:00.313298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.313276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:19:00.313470 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.313336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:00.313470 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.313363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:19:00.313470 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.313401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:19:00.315565 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.315538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"image-registry-757c745fb4-8585r\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:00.315701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.315680 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ddfbf611-621e-4781-8d8b-5039d88eb99b-metrics-tls\") pod \"dns-default-5btpk\" (UID: \"ddfbf611-621e-4781-8d8b-5039d88eb99b\") " pod="openshift-dns/dns-default-5btpk" Jun 15 03:19:00.315777 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.315762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7fdcd33c-814c-472d-a645-e48e8ab2733e-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-78tmp\" (UID: \"7fdcd33c-814c-472d-a645-e48e8ab2733e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:19:00.315926 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.315911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a55324fd-0b52-4171-a3cf-e3bd800c8b27-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-jv7nv\" (UID: \"a55324fd-0b52-4171-a3cf-e3bd800c8b27\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:19:00.316039 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.315960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/476951b2-68d4-494b-b9f4-7151eb1287c0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-kmgvd\" (UID: \"476951b2-68d4-494b-b9f4-7151eb1287c0\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:19:00.382343 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.382313 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfvvs" event={"ID":"71432268-0183-44a0-9869-2b8c1efd7b9f","Type":"ContainerStarted","Data":"153aea111165b82127748821dbff09d833ea4b2e98db1f21a085f26d5e61ff88"} Jun 15 03:19:00.382705 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.382367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfvvs" event={"ID":"71432268-0183-44a0-9869-2b8c1efd7b9f","Type":"ContainerStarted","Data":"e7bda1f1c6c026baf1ac6d538c55a1ed04ab5e5355c7c9f3742b22ad17d62de1"} Jun 15 03:19:00.382705 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.382414 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:19:00.383771 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.383741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8bp2g" event={"ID":"80a405e9-d122-4234-8d5b-7957e771d871","Type":"ContainerStarted","Data":"62e8d93767dc043e3cca7752d793129c05324037aa269f56516298a7e8911df9"} Jun 15 03:19:00.385684 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.385663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qjzv8" event={"ID":"b50e4574-40e3-4b2e-b9a9-b8b973279d77","Type":"ContainerStarted","Data":"22c1be18680cbe71606877a7e8fc859c4f3fdb1c700be1e733310b9cde882a6a"} Jun 15 03:19:00.386868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.386845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bk8st" event={"ID":"50486edf-f3f6-4da6-bf76-65c1b6388548","Type":"ContainerStarted","Data":"bf47e45d82898730e95e2e0922d316c3f3858e09cefc041097a1ac694de48fdb"} Jun 15 03:19:00.397263 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.397218 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hfvvs" podStartSLOduration=66.397202844 podStartE2EDuration="1m6.397202844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:00.395970651 +0000 UTC m=+66.870906107" watchObservedRunningTime="2026-06-15 03:19:00.397202844 +0000 UTC m=+66.872138299" Jun 15 03:19:00.414086 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.414055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:00.414175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.414099 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:00.414754 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.414722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-service-ca-bundle\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:00.416560 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.416539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4ff6f0d-4802-479f-a1d5-f5f6f42e0405-metrics-certs\") pod \"router-default-66bd986dc6-w8m6k\" (UID: \"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405\") " pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:00.482360 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.482333 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-lv6bc\"" Jun 15 03:19:00.490941 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.490913 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:00.498457 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.498440 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qp6m5\"" Jun 15 03:19:00.506843 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.506825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" Jun 15 03:19:00.520982 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.520954 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vhww2\"" Jun 15 03:19:00.525339 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.525302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" Jun 15 03:19:00.555612 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.555398 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w8plj\"" Jun 15 03:19:00.561978 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.561811 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-45fmz\"" Jun 15 03:19:00.563626 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.563326 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5btpk" Jun 15 03:19:00.572145 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.570323 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" Jun 15 03:19:00.576770 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.576401 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-h5v66\"" Jun 15 03:19:00.586885 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.584569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:00.673438 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.673353 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-757c745fb4-8585r"] Jun 15 03:19:00.719134 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.719063 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd"] Jun 15 03:19:00.770908 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.770833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp"] Jun 15 03:19:00.836342 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.834637 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-jv7nv"] Jun 15 03:19:00.839510 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:00.839479 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55324fd_0b52_4171_a3cf_e3bd800c8b27.slice/crio-d71c59a34f5b0b43d9357001f4c2260bf7401c260a0e5abe7de2279f2badfdc3 WatchSource:0}: Error finding container d71c59a34f5b0b43d9357001f4c2260bf7401c260a0e5abe7de2279f2badfdc3: Status 404 returned error can't find the container with id d71c59a34f5b0b43d9357001f4c2260bf7401c260a0e5abe7de2279f2badfdc3 Jun 15 03:19:00.864347 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:00.864284 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66bd986dc6-w8m6k"] Jun 15 03:19:00.869661 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:00.869635 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ff6f0d_4802_479f_a1d5_f5f6f42e0405.slice/crio-a13052a2c51c4a95f18babe5f85ce1c5aedde589449fb975f921867494e9cd2d WatchSource:0}: Error finding container a13052a2c51c4a95f18babe5f85ce1c5aedde589449fb975f921867494e9cd2d: Status 404 returned error can't find the container with id a13052a2c51c4a95f18babe5f85ce1c5aedde589449fb975f921867494e9cd2d Jun 15 03:19:01.012566 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.012188 2562 scope.go:117] "RemoveContainer" containerID="c6366d1961166d461319cdcaf83e9237aab9d53ff72ed6e20aab61cb48b2b253" Jun 15 03:19:01.072143 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.072035 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5btpk"] Jun 15 03:19:01.076178 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:01.076030 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddfbf611_621e_4781_8d8b_5039d88eb99b.slice/crio-c1f7f4d620f56bb4c3d08c1cb8201a9adac76e2a216639c3d9cb3007e15dda1e WatchSource:0}: Error finding container c1f7f4d620f56bb4c3d08c1cb8201a9adac76e2a216639c3d9cb3007e15dda1e: Status 404 returned error can't find the container with id c1f7f4d620f56bb4c3d08c1cb8201a9adac76e2a216639c3d9cb3007e15dda1e Jun 15 03:19:01.396162 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.396070 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" event={"ID":"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405","Type":"ContainerStarted","Data":"33de1a95bd616609f0da639ebf6c2b216386900df8b23838651fbb9c7f41832e"} Jun 15 03:19:01.396162 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.396127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" event={"ID":"b4ff6f0d-4802-479f-a1d5-f5f6f42e0405","Type":"ContainerStarted","Data":"a13052a2c51c4a95f18babe5f85ce1c5aedde589449fb975f921867494e9cd2d"} Jun 15 03:19:01.403148 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.403080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5btpk" event={"ID":"ddfbf611-621e-4781-8d8b-5039d88eb99b","Type":"ContainerStarted","Data":"c1f7f4d620f56bb4c3d08c1cb8201a9adac76e2a216639c3d9cb3007e15dda1e"} Jun 15 03:19:01.406350 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.406255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" event={"ID":"7fdcd33c-814c-472d-a645-e48e8ab2733e","Type":"ContainerStarted","Data":"35c454a7183e5424afd1160b17074a19d08d942d3eeabeffbe367865b87989ca"} Jun 15 03:19:01.409583 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.409554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757c745fb4-8585r" event={"ID":"3b353ecf-65d4-4f9e-8741-13aa18442556","Type":"ContainerStarted","Data":"2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0"} Jun 15 03:19:01.409698 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.409603 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757c745fb4-8585r" event={"ID":"3b353ecf-65d4-4f9e-8741-13aa18442556","Type":"ContainerStarted","Data":"99997c913609ab7af84b0f619101ae25071dd3b8e074addc839e96dae5ab61dc"} Jun 15 03:19:01.410175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.410155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:01.412646 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.412627 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:19:01.412745 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.412722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" event={"ID":"6a660f48-a8f1-4920-8aa3-003554456b23","Type":"ContainerStarted","Data":"6c08560f6590b079e832b9100b1a32e2a82ffab49b062aadb92f121f5b0b13be"} Jun 15 03:19:01.413404 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.413385 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:19:01.414561 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.414538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" event={"ID":"a55324fd-0b52-4171-a3cf-e3bd800c8b27","Type":"ContainerStarted","Data":"d71c59a34f5b0b43d9357001f4c2260bf7401c260a0e5abe7de2279f2badfdc3"} Jun 15 03:19:01.416662 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.416639 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" event={"ID":"476951b2-68d4-494b-b9f4-7151eb1287c0","Type":"ContainerStarted","Data":"25e621e621bfba0217a93fd8429d0fd5fde55b71113380bd9f09143f6e57bc02"} Jun 15 03:19:01.419943 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.418010 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" podStartSLOduration=50.417992642 podStartE2EDuration="50.417992642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:01.417620912 +0000 UTC m=+67.892556373" watchObservedRunningTime="2026-06-15 03:19:01.417992642 +0000 UTC m=+67.892928097" Jun 15 03:19:01.441134 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.441081 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-757c745fb4-8585r" podStartSLOduration=67.441061364 podStartE2EDuration="1m7.441061364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:01.439642833 +0000 UTC m=+67.914578288" watchObservedRunningTime="2026-06-15 03:19:01.441061364 +0000 UTC m=+67.915996818" Jun 15 03:19:01.454987 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.454909 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" podStartSLOduration=41.24733008 podStartE2EDuration="50.454886789s" totalImagesPullingTime="9.207556709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:01.454118986 +0000 UTC m=+67.929054440" watchObservedRunningTime="2026-06-15 03:19:01.454886789 +0000 UTC m=+67.929822247" Jun 15 03:19:01.585504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.585255 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:01.588164 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.587909 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:01.598796 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:01.598762 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-b55b8" Jun 15 03:19:02.423252 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:02.423191 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:02.425053 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:02.424835 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66bd986dc6-w8m6k" Jun 15 03:19:03.124176 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.124140 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4"] Jun 15 03:19:03.128053 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.128027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.130348 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.130315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 15 03:19:03.130457 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.130315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 15 03:19:03.131369 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.131128 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 15 03:19:03.132007 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.131812 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 15 03:19:03.133658 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.133514 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 15 03:19:03.133658 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.133526 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 15 03:19:03.133658 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.133521 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 15 03:19:03.145189 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.145166 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4"] Jun 15 03:19:03.243118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.243082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-hub\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.243282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.243135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.243282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.243163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79467ec6-05ca-4cbb-a5d2-2e14b957c635-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.243282 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.243243 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-ca\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.243431 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.243288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.243431 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.243322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z268w\" (UniqueName: \"kubernetes.io/projected/79467ec6-05ca-4cbb-a5d2-2e14b957c635-kube-api-access-z268w\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.344813 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.344723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-ca\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.344813 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.344791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.345078 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.344831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z268w\" (UniqueName: \"kubernetes.io/projected/79467ec6-05ca-4cbb-a5d2-2e14b957c635-kube-api-access-z268w\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.345078 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.344861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-hub\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.345078 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.344895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.345078 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.344921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79467ec6-05ca-4cbb-a5d2-2e14b957c635-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.345727 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.345697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/79467ec6-05ca-4cbb-a5d2-2e14b957c635-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.347708 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.347680 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-ca\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.348315 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.348270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.348315 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.348302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-hub\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.348579 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.348540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79467ec6-05ca-4cbb-a5d2-2e14b957c635-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.355184 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.355162 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z268w\" (UniqueName: \"kubernetes.io/projected/79467ec6-05ca-4cbb-a5d2-2e14b957c635-kube-api-access-z268w\") pod \"cluster-proxy-proxy-agent-6b7b8fc769-sz8n4\" (UID: \"79467ec6-05ca-4cbb-a5d2-2e14b957c635\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:03.447747 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:03.447542 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" Jun 15 03:19:06.595224 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:06.595158 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4"] Jun 15 03:19:06.599176 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:06.599148 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79467ec6_05ca_4cbb_a5d2_2e14b957c635.slice/crio-98f563a2d5bd0d18ab9cf0ea86b2d2c9c2bedffabdb2e09ea6003cee00035798 WatchSource:0}: Error finding container 98f563a2d5bd0d18ab9cf0ea86b2d2c9c2bedffabdb2e09ea6003cee00035798: Status 404 returned error can't find the container with id 98f563a2d5bd0d18ab9cf0ea86b2d2c9c2bedffabdb2e09ea6003cee00035798 Jun 15 03:19:07.444723 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.444681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" event={"ID":"476951b2-68d4-494b-b9f4-7151eb1287c0","Type":"ContainerStarted","Data":"8226800db9e18eeeeaba1d4c26917b635b97a4c83125a3699e2307370b98ae57"} Jun 15 03:19:07.447269 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.447221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qjzv8" event={"ID":"b50e4574-40e3-4b2e-b9a9-b8b973279d77","Type":"ContainerStarted","Data":"5b77726cf5eec690192c2833de2001492572dbfacc5c67ace1cc70d9f4a2a19c"} Jun 15 03:19:07.449469 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.449441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bk8st" event={"ID":"50486edf-f3f6-4da6-bf76-65c1b6388548","Type":"ContainerStarted","Data":"4582f29db84d1b4cd6b06896fc6853f0ec239d42d4917fc83cb633b7cd4da841"} Jun 15 03:19:07.449552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.449493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bk8st" event={"ID":"50486edf-f3f6-4da6-bf76-65c1b6388548","Type":"ContainerStarted","Data":"4eeb4c09dcc3062dc1e55e4349f49f878d1de557918347d0c6f7b96cd07e6f22"} Jun 15 03:19:07.451880 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.451853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5btpk" event={"ID":"ddfbf611-621e-4781-8d8b-5039d88eb99b","Type":"ContainerStarted","Data":"b34e4fee8edb49a987944a9f6891b376677db7376ffffcb8112daac83bf70bdb"} Jun 15 03:19:07.451986 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.451903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5btpk" event={"ID":"ddfbf611-621e-4781-8d8b-5039d88eb99b","Type":"ContainerStarted","Data":"424202c60651dadc0fc75bd076ebead329ce69c6ebb01c3f49f784b932a8bc3a"} Jun 15 03:19:07.451986 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.451964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5btpk" Jun 15 03:19:07.453998 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.453971 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" event={"ID":"7fdcd33c-814c-472d-a645-e48e8ab2733e","Type":"ContainerStarted","Data":"8bc3ce9f5e745b22cfe1b98250ddbb1f58726a5ff959d1a33be49527fc8faf85"} Jun 15 03:19:07.454121 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.454022 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" event={"ID":"7fdcd33c-814c-472d-a645-e48e8ab2733e","Type":"ContainerStarted","Data":"f494165dce05252aee85cd645158e9f88ad510981ef89c62ce8ead0b1fcafaeb"} Jun 15 03:19:07.455222 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.455199 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" event={"ID":"79467ec6-05ca-4cbb-a5d2-2e14b957c635","Type":"ContainerStarted","Data":"98f563a2d5bd0d18ab9cf0ea86b2d2c9c2bedffabdb2e09ea6003cee00035798"} Jun 15 03:19:07.456699 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.456668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8bp2g" event={"ID":"80a405e9-d122-4234-8d5b-7957e771d871","Type":"ContainerStarted","Data":"0df90a024577936b6dcd3a859d7bf41542ed0883d5d9af3d60f6211730cce7c5"} Jun 15 03:19:07.458279 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.458255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" event={"ID":"a55324fd-0b52-4171-a3cf-e3bd800c8b27","Type":"ContainerStarted","Data":"cc9e6283a7e89d37406fbc45be3c1d356f71aa5407b334187a417be0b1122312"} Jun 15 03:19:07.459304 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.459254 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-kmgvd" podStartSLOduration=50.756017105 podStartE2EDuration="56.459238861s" totalImagesPullingTime="5.703221756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.458477561 +0000 UTC m=+73.933413019" watchObservedRunningTime="2026-06-15 03:19:07.459238861 +0000 UTC m=+73.934174315" Jun 15 03:19:07.491677 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.491623 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-jv7nv" podStartSLOduration=50.878738972 podStartE2EDuration="56.491603106s" totalImagesPullingTime="5.612864134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.478044473 +0000 UTC m=+73.952979929" watchObservedRunningTime="2026-06-15 03:19:07.491603106 +0000 UTC m=+73.966538562" Jun 15 03:19:07.492948 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.492838 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bk8st" podStartSLOduration=68.763703836 podStartE2EDuration="1m13.492822924s" totalImagesPullingTime="4.729119088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.491371235 +0000 UTC m=+73.966306692" watchObservedRunningTime="2026-06-15 03:19:07.492822924 +0000 UTC m=+73.967758380" Jun 15 03:19:07.512899 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.512100 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8bp2g" podStartSLOduration=66.615848666 podStartE2EDuration="1m13.512087478s" totalImagesPullingTime="6.896238812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.511007704 +0000 UTC m=+73.985943170" watchObservedRunningTime="2026-06-15 03:19:07.512087478 +0000 UTC m=+73.987022933" Jun 15 03:19:07.527067 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.526748 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-78tmp" podStartSLOduration=50.913425707 podStartE2EDuration="56.526736875s" totalImagesPullingTime="5.613311168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.526256394 +0000 UTC m=+74.001191849" watchObservedRunningTime="2026-06-15 03:19:07.526736875 +0000 UTC m=+74.001672330" Jun 15 03:19:07.543794 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.543627 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qjzv8" podStartSLOduration=19.513328016 podStartE2EDuration="28.543609812s" totalImagesPullingTime="9.030281796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:18:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.541169041 +0000 UTC m=+74.016104521" watchObservedRunningTime="2026-06-15 03:19:07.543609812 +0000 UTC m=+74.018545268" Jun 15 03:19:07.557892 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:07.557827 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5btpk" podStartSLOduration=34.179368263 podStartE2EDuration="39.557808808s" totalImagesPullingTime="5.378440545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:18:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:07.556231692 +0000 UTC m=+74.031167151" watchObservedRunningTime="2026-06-15 03:19:07.557808808 +0000 UTC m=+74.032744263" Jun 15 03:19:11.478353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:11.478320 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" event={"ID":"79467ec6-05ca-4cbb-a5d2-2e14b957c635","Type":"ContainerStarted","Data":"ad8ab518b6cd188460b96edbcf68432f9a19d413e9b52f1347874f8d2758ebd3"} Jun 15 03:19:11.478803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:11.478368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" event={"ID":"79467ec6-05ca-4cbb-a5d2-2e14b957c635","Type":"ContainerStarted","Data":"83bcdfe6b8f1e984194dae0a5aad8c174b02586eeb516e918082e19f655e4495"} Jun 15 03:19:11.478803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:11.478381 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" event={"ID":"79467ec6-05ca-4cbb-a5d2-2e14b957c635","Type":"ContainerStarted","Data":"6d5ace44035047de1f19b4047932e5cd8cf91825c5493b708b7b37c720c6b13f"} Jun 15 03:19:11.496947 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:11.496887 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6b7b8fc769-sz8n4" podStartSLOduration=4.4294622 podStartE2EDuration="8.496873461s" totalImagesPullingTime="4.067411261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:11.495971026 +0000 UTC m=+77.970906480" watchObservedRunningTime="2026-06-15 03:19:11.496873461 +0000 UTC m=+77.971808915" Jun 15 03:19:12.489658 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.489629 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f4dd7b5f6-bmpbs"] Jun 15 03:19:12.504394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.504372 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4dd7b5f6-bmpbs"] Jun 15 03:19:12.504532 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.504460 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.506696 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.506664 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 03:19:12.506846 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.506718 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 03:19:12.506846 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.506766 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 03:19:12.507042 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.507023 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-snt88\"" Jun 15 03:19:12.507660 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.507471 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 03:19:12.507660 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.507487 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 03:19:12.507660 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.507556 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 03:19:12.507977 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.507696 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 03:19:12.527701 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.527677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcpxj\" (UniqueName: \"kubernetes.io/projected/f828cad4-224c-4780-910d-36b22cca5688-kube-api-access-hcpxj\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.527975 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.527954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-console-config\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.528055 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.528006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-oauth-config\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.528055 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.528040 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-service-ca\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.528171 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.528110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-oauth-serving-cert\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.528225 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.528163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-serving-cert\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.628519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.628483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-oauth-serving-cert\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.628519 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.628520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-serving-cert\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.628792 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.628571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcpxj\" (UniqueName: \"kubernetes.io/projected/f828cad4-224c-4780-910d-36b22cca5688-kube-api-access-hcpxj\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.628792 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.628611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-console-config\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.628792 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.628649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-oauth-config\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.628792 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.628679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-service-ca\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.629313 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.629282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-console-config\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.629313 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.629291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-oauth-serving-cert\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.629471 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.629327 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-service-ca\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.631138 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.631107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-serving-cert\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.631206 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.631140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-oauth-config\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.636876 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.636855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcpxj\" (UniqueName: \"kubernetes.io/projected/f828cad4-224c-4780-910d-36b22cca5688-kube-api-access-hcpxj\") pod \"console-6f4dd7b5f6-bmpbs\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.814549 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.814465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:12.959728 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:12.959700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f4dd7b5f6-bmpbs"] Jun 15 03:19:12.963966 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:12.963919 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf828cad4_224c_4780_910d_36b22cca5688.slice/crio-468bc9a231a73b39c2d184f768b491ce760a79862fa1efa210f486b525ca94a3 WatchSource:0}: Error finding container 468bc9a231a73b39c2d184f768b491ce760a79862fa1efa210f486b525ca94a3: Status 404 returned error can't find the container with id 468bc9a231a73b39c2d184f768b491ce760a79862fa1efa210f486b525ca94a3 Jun 15 03:19:13.486912 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:13.486795 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dd7b5f6-bmpbs" event={"ID":"f828cad4-224c-4780-910d-36b22cca5688","Type":"ContainerStarted","Data":"468bc9a231a73b39c2d184f768b491ce760a79862fa1efa210f486b525ca94a3"} Jun 15 03:19:16.499013 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:16.498914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dd7b5f6-bmpbs" event={"ID":"f828cad4-224c-4780-910d-36b22cca5688","Type":"ContainerStarted","Data":"4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6"} Jun 15 03:19:16.514574 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:16.514526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f4dd7b5f6-bmpbs" podStartSLOduration=1.302871774 podStartE2EDuration="4.514512052s" totalImagesPullingTime="3.211640278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:16.51339163 +0000 UTC m=+82.988327107" watchObservedRunningTime="2026-06-15 03:19:16.514512052 +0000 UTC m=+82.989447506" Jun 15 03:19:17.466398 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:17.466368 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5btpk" Jun 15 03:19:19.564602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.564570 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b5rsn"] Jun 15 03:19:19.568083 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.568064 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.570375 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.570342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 03:19:19.570516 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.570387 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 03:19:19.570589 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.570521 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 03:19:19.570589 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.570527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 03:19:19.570769 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.570754 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z4qgl\"" Jun 15 03:19:19.585411 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585517 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-accelerators-collector-config\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585517 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585509 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-wtmp\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585517 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/097568c6-35b1-4f02-b9be-2d747c252d73-metrics-client-ca\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585667 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t58js\" (UniqueName: \"kubernetes.io/projected/097568c6-35b1-4f02-b9be-2d747c252d73-kube-api-access-t58js\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585667 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-textfile\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585667 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585667 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-sys\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.585782 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.585675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-root\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686361 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-wtmp\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686361 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/097568c6-35b1-4f02-b9be-2d747c252d73-metrics-client-ca\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686563 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t58js\" (UniqueName: \"kubernetes.io/projected/097568c6-35b1-4f02-b9be-2d747c252d73-kube-api-access-t58js\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686563 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-textfile\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686563 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686563 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-wtmp\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686563 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-sys\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686563 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-root\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-root\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686626 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/097568c6-35b1-4f02-b9be-2d747c252d73-sys\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-accelerators-collector-config\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:19:19.686701 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:19:19.686767 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls podName:097568c6-35b1-4f02-b9be-2d747c252d73 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:20.186749077 +0000 UTC m=+86.661684523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls") pod "node-exporter-b5rsn" (UID: "097568c6-35b1-4f02-b9be-2d747c252d73") : secret "node-exporter-tls" not found Jun 15 03:19:19.686868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.686843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-textfile\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.687211 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.687061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/097568c6-35b1-4f02-b9be-2d747c252d73-metrics-client-ca\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.687211 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.687129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-accelerators-collector-config\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.688865 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.688841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:19.695463 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:19.695439 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t58js\" (UniqueName: \"kubernetes.io/projected/097568c6-35b1-4f02-b9be-2d747c252d73-kube-api-access-t58js\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:20.190112 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:20.190083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:20.190290 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:19:20.190224 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 03:19:20.190290 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:19:20.190278 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls podName:097568c6-35b1-4f02-b9be-2d747c252d73 nodeName:}" failed. No retries permitted until 2026-06-15 03:19:21.190264072 +0000 UTC m=+87.665199504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls") pod "node-exporter-b5rsn" (UID: "097568c6-35b1-4f02-b9be-2d747c252d73") : secret "node-exporter-tls" not found Jun 15 03:19:21.198588 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:21.198555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:21.200765 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:21.200734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/097568c6-35b1-4f02-b9be-2d747c252d73-node-exporter-tls\") pod \"node-exporter-b5rsn\" (UID: \"097568c6-35b1-4f02-b9be-2d747c252d73\") " pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:21.378394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:21.378365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b5rsn" Jun 15 03:19:21.391755 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:21.391721 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097568c6_35b1_4f02_b9be_2d747c252d73.slice/crio-72522a52fad729953b7f9c57bff8912ea7681b248b4996b53ba47aed05927b10 WatchSource:0}: Error finding container 72522a52fad729953b7f9c57bff8912ea7681b248b4996b53ba47aed05927b10: Status 404 returned error can't find the container with id 72522a52fad729953b7f9c57bff8912ea7681b248b4996b53ba47aed05927b10 Jun 15 03:19:21.518737 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:21.518645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b5rsn" event={"ID":"097568c6-35b1-4f02-b9be-2d747c252d73","Type":"ContainerStarted","Data":"72522a52fad729953b7f9c57bff8912ea7681b248b4996b53ba47aed05927b10"} Jun 15 03:19:22.427520 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.427492 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:22.520375 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.520354 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d64dd9df4-4n2wq"] Jun 15 03:19:22.524020 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.524001 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.526127 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526101 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 03:19:22.526275 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526257 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 03:19:22.526275 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 03:19:22.526403 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526321 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 03:19:22.526403 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526341 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 03:19:22.526403 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526347 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xf9j7\"" Jun 15 03:19:22.526560 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.526537 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2c5tko8m2nlu9\"" Jun 15 03:19:22.538120 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.538098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d64dd9df4-4n2wq"] Jun 15 03:19:22.613037 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-grpc-tls\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-tls\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613107 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4s65\" (UniqueName: \"kubernetes.io/projected/beb43489-9ab5-47c6-bef9-8a90712a6f0a-kube-api-access-q4s65\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.613323 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.613262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb43489-9ab5-47c6-bef9-8a90712a6f0a-metrics-client-ca\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb43489-9ab5-47c6-bef9-8a90712a6f0a-metrics-client-ca\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-grpc-tls\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-tls\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714222 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.714619 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.714454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4s65\" (UniqueName: \"kubernetes.io/projected/beb43489-9ab5-47c6-bef9-8a90712a6f0a-kube-api-access-q4s65\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.715065 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.715023 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beb43489-9ab5-47c6-bef9-8a90712a6f0a-metrics-client-ca\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.716923 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.716892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.717196 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.717150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-grpc-tls\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.717196 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.717181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.717322 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.717261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.717365 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.717316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-tls\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.717365 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.717328 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/beb43489-9ab5-47c6-bef9-8a90712a6f0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.722642 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.722622 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4s65\" (UniqueName: \"kubernetes.io/projected/beb43489-9ab5-47c6-bef9-8a90712a6f0a-kube-api-access-q4s65\") pod \"thanos-querier-d64dd9df4-4n2wq\" (UID: \"beb43489-9ab5-47c6-bef9-8a90712a6f0a\") " pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.815650 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.815618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:22.815773 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.815686 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:22.820463 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.820437 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:22.833229 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.833207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:22.967099 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:22.966949 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d64dd9df4-4n2wq"] Jun 15 03:19:22.969562 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:22.969532 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb43489_9ab5_47c6_bef9_8a90712a6f0a.slice/crio-6ce6d2c1ab0da962ea838a8efa407d05f432e3b0e7b7aa989398c69557c10e61 WatchSource:0}: Error finding container 6ce6d2c1ab0da962ea838a8efa407d05f432e3b0e7b7aa989398c69557c10e61: Status 404 returned error can't find the container with id 6ce6d2c1ab0da962ea838a8efa407d05f432e3b0e7b7aa989398c69557c10e61 Jun 15 03:19:23.529524 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.529481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"6ce6d2c1ab0da962ea838a8efa407d05f432e3b0e7b7aa989398c69557c10e61"} Jun 15 03:19:23.531326 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.531294 2562 generic.go:356] "Generic (PLEG): container finished" podID="097568c6-35b1-4f02-b9be-2d747c252d73" containerID="90015f3f7ab88512db7b0c1b738b9906eeac3c58e989feeebe323af4d0b327dd" exitCode=0 Jun 15 03:19:23.531472 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.531376 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b5rsn" event={"ID":"097568c6-35b1-4f02-b9be-2d747c252d73","Type":"ContainerDied","Data":"90015f3f7ab88512db7b0c1b738b9906eeac3c58e989feeebe323af4d0b327dd"} Jun 15 03:19:23.536143 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.536122 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:19:23.933288 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.933251 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5c489ff7c5-z4g2w"] Jun 15 03:19:23.936773 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.936747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:23.938964 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.938918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 03:19:23.939080 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.938993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 03:19:23.939637 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.939615 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 03:19:23.939736 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.939687 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 03:19:23.939832 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.939804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mg6xn\"" Jun 15 03:19:23.939975 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.939890 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6p0vn9vcdtdoh\"" Jun 15 03:19:23.946958 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:23.946920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c489ff7c5-z4g2w"] Jun 15 03:19:24.026836 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.026791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3ced8bcb-fec0-4430-99f3-0e1291989c3c-audit-log\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.027052 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.026843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-secret-metrics-server-tls\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.027052 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.026871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nwhl\" (UniqueName: \"kubernetes.io/projected/3ced8bcb-fec0-4430-99f3-0e1291989c3c-kube-api-access-4nwhl\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.027052 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.027001 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-client-ca-bundle\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.027052 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.027039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3ced8bcb-fec0-4430-99f3-0e1291989c3c-metrics-server-audit-profiles\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.027242 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.027094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ced8bcb-fec0-4430-99f3-0e1291989c3c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.027242 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.027137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-secret-metrics-server-client-certs\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.127922 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.127874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ced8bcb-fec0-4430-99f3-0e1291989c3c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.127970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-secret-metrics-server-client-certs\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3ced8bcb-fec0-4430-99f3-0e1291989c3c-audit-log\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128249 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-secret-metrics-server-tls\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128304 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nwhl\" (UniqueName: \"kubernetes.io/projected/3ced8bcb-fec0-4430-99f3-0e1291989c3c-kube-api-access-4nwhl\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-client-ca-bundle\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3ced8bcb-fec0-4430-99f3-0e1291989c3c-metrics-server-audit-profiles\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128459 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3ced8bcb-fec0-4430-99f3-0e1291989c3c-audit-log\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.128949 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.128702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3ced8bcb-fec0-4430-99f3-0e1291989c3c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.129395 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.129346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3ced8bcb-fec0-4430-99f3-0e1291989c3c-metrics-server-audit-profiles\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.131119 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.131096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-client-ca-bundle\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.131273 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.131229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-secret-metrics-server-tls\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.131273 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.131260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3ced8bcb-fec0-4430-99f3-0e1291989c3c-secret-metrics-server-client-certs\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.135525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.135502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nwhl\" (UniqueName: \"kubernetes.io/projected/3ced8bcb-fec0-4430-99f3-0e1291989c3c-kube-api-access-4nwhl\") pod \"metrics-server-5c489ff7c5-z4g2w\" (UID: \"3ced8bcb-fec0-4430-99f3-0e1291989c3c\") " pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.249978 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.249700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:24.394837 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.394792 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5c489ff7c5-z4g2w"] Jun 15 03:19:24.398801 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:24.398773 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ced8bcb_fec0_4430_99f3_0e1291989c3c.slice/crio-0041770346f645aa2b721605ff6620074324a7fbe1c8ab3cd2390736c6f0fb1b WatchSource:0}: Error finding container 0041770346f645aa2b721605ff6620074324a7fbe1c8ab3cd2390736c6f0fb1b: Status 404 returned error can't find the container with id 0041770346f645aa2b721605ff6620074324a7fbe1c8ab3cd2390736c6f0fb1b Jun 15 03:19:24.527132 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.527044 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58ffdc6dd6-8fpsk"] Jun 15 03:19:24.531516 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.531490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.536739 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.536705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" event={"ID":"3ced8bcb-fec0-4430-99f3-0e1291989c3c","Type":"ContainerStarted","Data":"0041770346f645aa2b721605ff6620074324a7fbe1c8ab3cd2390736c6f0fb1b"} Jun 15 03:19:24.539641 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.539407 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58ffdc6dd6-8fpsk"] Jun 15 03:19:24.545599 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.545558 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 03:19:24.546794 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.546763 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b5rsn" event={"ID":"097568c6-35b1-4f02-b9be-2d747c252d73","Type":"ContainerStarted","Data":"0e9ab30e322c2313cbadb9c68ef46eadf541fbaea1c91d66a3c0fb6482fefcc2"} Jun 15 03:19:24.546878 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.546857 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b5rsn" event={"ID":"097568c6-35b1-4f02-b9be-2d747c252d73","Type":"ContainerStarted","Data":"8e76eb73670d94775a78dcf461caef2fe7add64a693e287c3fab22ca68b382c5"} Jun 15 03:19:24.565435 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.565392 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b5rsn" podStartSLOduration=4.428501643 podStartE2EDuration="5.565376119s" totalImagesPullingTime="1.070831961s" totalInitContainerRuntime="66.042515ms" isStatefulPod=true podCreationTimestamp="2026-06-15 03:19:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:24.564606219 +0000 UTC m=+91.039541676" watchObservedRunningTime="2026-06-15 03:19:24.565376119 +0000 UTC m=+91.040311576" Jun 15 03:19:24.632839 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.632794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-trusted-ca-bundle\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.633061 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.632980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-oauth-serving-cert\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.633061 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.633026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-serving-cert\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.633167 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.633131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-config\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.633267 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.633250 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-service-ca\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.633298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.633279 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-oauth-config\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.633330 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.633310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4xv\" (UniqueName: \"kubernetes.io/projected/2d3fb373-5cac-45da-a3b4-d8feb654acde-kube-api-access-mc4xv\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734499 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-oauth-serving-cert\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-serving-cert\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-config\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-service-ca\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-oauth-config\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734649 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4xv\" (UniqueName: \"kubernetes.io/projected/2d3fb373-5cac-45da-a3b4-d8feb654acde-kube-api-access-mc4xv\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.734926 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.734712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-trusted-ca-bundle\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.735365 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.735326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-oauth-serving-cert\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.735365 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.735346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-config\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.735602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.735553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-service-ca\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.735602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.735565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-trusted-ca-bundle\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.737275 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.737254 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-serving-cert\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.737432 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.737404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-oauth-config\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.743227 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.743208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4xv\" (UniqueName: \"kubernetes.io/projected/2d3fb373-5cac-45da-a3b4-d8feb654acde-kube-api-access-mc4xv\") pod \"console-58ffdc6dd6-8fpsk\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:24.847948 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:24.847851 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:25.344343 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.344319 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58ffdc6dd6-8fpsk"] Jun 15 03:19:25.347244 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:19:25.347218 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3fb373_5cac_45da_a3b4_d8feb654acde.slice/crio-cf6611a58cbfc9c66e7607c3319fd8e447739b557a82a0c384bb9fb777b69010 WatchSource:0}: Error finding container cf6611a58cbfc9c66e7607c3319fd8e447739b557a82a0c384bb9fb777b69010: Status 404 returned error can't find the container with id cf6611a58cbfc9c66e7607c3319fd8e447739b557a82a0c384bb9fb777b69010 Jun 15 03:19:25.552754 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.552722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ffdc6dd6-8fpsk" event={"ID":"2d3fb373-5cac-45da-a3b4-d8feb654acde","Type":"ContainerStarted","Data":"90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57"} Jun 15 03:19:25.553136 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.552776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ffdc6dd6-8fpsk" event={"ID":"2d3fb373-5cac-45da-a3b4-d8feb654acde","Type":"ContainerStarted","Data":"cf6611a58cbfc9c66e7607c3319fd8e447739b557a82a0c384bb9fb777b69010"} Jun 15 03:19:25.554822 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.554788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"8120b60444ef82a86c9aaf333146dfb4aaff69deceae9de1df1dd5b91a6f15f1"} Jun 15 03:19:25.554912 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.554863 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"16ea047610fa7690933d07c8d14dc67178ae9fe85aa5ad40a14c0e92b1313d75"} Jun 15 03:19:25.554912 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.554891 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"56dae8bd12d51e2e7a03fd97ee6837172124e8ee3bf39eef7608f4ef7874fbea"} Jun 15 03:19:25.573769 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:25.573725 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58ffdc6dd6-8fpsk" podStartSLOduration=1.573708836 podStartE2EDuration="1.573708836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:25.572761045 +0000 UTC m=+92.047696502" watchObservedRunningTime="2026-06-15 03:19:25.573708836 +0000 UTC m=+92.048644291" Jun 15 03:19:26.384780 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:26.384728 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-757c745fb4-8585r"] Jun 15 03:19:27.569591 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.569550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" event={"ID":"3ced8bcb-fec0-4430-99f3-0e1291989c3c","Type":"ContainerStarted","Data":"874557d95b17fe9ff8b4d17406514ac5b85150722d49d77421fff83699259890"} Jun 15 03:19:27.572525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.572496 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"eb35ea50073ca5551a5d4a91edbbcc5674b95a5c8e4e1a9056b7ff15372e9943"} Jun 15 03:19:27.572666 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.572556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"8009f79372e452fdd6f71a8ba4b051369d1952613712d124d6b1e59e847c7652"} Jun 15 03:19:27.572666 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.572583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" event={"ID":"beb43489-9ab5-47c6-bef9-8a90712a6f0a","Type":"ContainerStarted","Data":"ee6f22e36fff33646e2aa8119ad3525bf7d346595680ce7cbffcf42ffd3f943e"} Jun 15 03:19:27.572666 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.572612 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:27.587039 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.586989 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" podStartSLOduration=2.4795366039999998 podStartE2EDuration="4.58697496s" totalImagesPullingTime="2.107438356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:27.585495058 +0000 UTC m=+94.060430512" watchObservedRunningTime="2026-06-15 03:19:27.58697496 +0000 UTC m=+94.061910391" Jun 15 03:19:27.606113 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:27.606069 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" podStartSLOduration=2.280445093 podStartE2EDuration="5.606054658s" totalImagesPullingTime="3.325609565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:19:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:19:27.604258279 +0000 UTC m=+94.079193733" watchObservedRunningTime="2026-06-15 03:19:27.606054658 +0000 UTC m=+94.080990135" Jun 15 03:19:31.419186 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:31.419155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hfvvs" Jun 15 03:19:33.584356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:33.584332 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d64dd9df4-4n2wq" Jun 15 03:19:34.848279 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:34.848227 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:34.848660 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:34.848318 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:34.853135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:34.853118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:35.610286 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:35.610256 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:19:35.656206 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:35.656180 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4dd7b5f6-bmpbs"] Jun 15 03:19:44.250234 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:44.250203 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:44.250658 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:44.250261 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:19:49.662619 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:49.662586 2562 generic.go:356] "Generic (PLEG): container finished" podID="50d27669-d4f9-4b8d-b294-bb8701250ae8" containerID="fa32c360b4e9471b4c29c5532379d2927056be8c1eef66a534707aeb2e41ca32" exitCode=0 Jun 15 03:19:49.663136 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:49.662660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" event={"ID":"50d27669-d4f9-4b8d-b294-bb8701250ae8","Type":"ContainerDied","Data":"fa32c360b4e9471b4c29c5532379d2927056be8c1eef66a534707aeb2e41ca32"} Jun 15 03:19:49.663136 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:49.663055 2562 scope.go:117] "RemoveContainer" containerID="fa32c360b4e9471b4c29c5532379d2927056be8c1eef66a534707aeb2e41ca32" Jun 15 03:19:49.664208 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:49.664189 2562 generic.go:356] "Generic (PLEG): container finished" podID="4875eebb-e655-4711-9650-01eedaf5ce3c" containerID="a888b46c3c297e280980db4c34bb814f7c33a0e176cee7d0800a8655d5d8d18e" exitCode=0 Jun 15 03:19:49.664318 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:49.664264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" event={"ID":"4875eebb-e655-4711-9650-01eedaf5ce3c","Type":"ContainerDied","Data":"a888b46c3c297e280980db4c34bb814f7c33a0e176cee7d0800a8655d5d8d18e"} Jun 15 03:19:49.664565 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:49.664549 2562 scope.go:117] "RemoveContainer" containerID="a888b46c3c297e280980db4c34bb814f7c33a0e176cee7d0800a8655d5d8d18e" Jun 15 03:19:50.279665 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:50.279611 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bd986dc6-w8m6k_b4ff6f0d-4802-479f-a1d5-f5f6f42e0405/router/0.log" Jun 15 03:19:50.290983 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:50.290959 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wl7rh_e491e7cd-4a61-448e-8494-57516ef4085c/serve-healthcheck-canary/0.log" Jun 15 03:19:50.670056 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:50.670020 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-7nnt7" event={"ID":"50d27669-d4f9-4b8d-b294-bb8701250ae8","Type":"ContainerStarted","Data":"4888bff0c3f3d9dcf7f006aec1ddb10a203b801cc9cfe841bb60e2093dcf888a"} Jun 15 03:19:50.671747 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:50.671728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-dc2m4" event={"ID":"4875eebb-e655-4711-9650-01eedaf5ce3c","Type":"ContainerStarted","Data":"ae7ed9650330a2a60abc15b5c1a2990033eed7b5d7923f7104e43c0b26b94bc9"} Jun 15 03:19:51.407346 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.407299 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-757c745fb4-8585r" podUID="3b353ecf-65d4-4f9e-8741-13aa18442556" containerName="registry" containerID="cri-o://2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0" gracePeriod=30 Jun 15 03:19:51.650099 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.650077 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:51.677904 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.677843 2562 generic.go:356] "Generic (PLEG): container finished" podID="3b353ecf-65d4-4f9e-8741-13aa18442556" containerID="2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0" exitCode=0 Jun 15 03:19:51.677904 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.677883 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-757c745fb4-8585r" Jun 15 03:19:51.678305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.677948 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757c745fb4-8585r" event={"ID":"3b353ecf-65d4-4f9e-8741-13aa18442556","Type":"ContainerDied","Data":"2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0"} Jun 15 03:19:51.678305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.678001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-757c745fb4-8585r" event={"ID":"3b353ecf-65d4-4f9e-8741-13aa18442556","Type":"ContainerDied","Data":"99997c913609ab7af84b0f619101ae25071dd3b8e074addc839e96dae5ab61dc"} Jun 15 03:19:51.678305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.678030 2562 scope.go:117] "RemoveContainer" containerID="2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0" Jun 15 03:19:51.690603 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.690579 2562 scope.go:117] "RemoveContainer" containerID="2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0" Jun 15 03:19:51.690973 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:19:51.690950 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0\": container with ID starting with 2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0 not found: ID does not exist" containerID="2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0" Jun 15 03:19:51.691084 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.690978 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0"} err="failed to get container status \"2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0\": rpc error: code = NotFound desc = could not find container \"2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0\": container with ID starting with 2f7d31974133207220207110fd8953ac54181e67f138e76084d069ef80fafac0 not found: ID does not exist" Jun 15 03:19:51.776322 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776297 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-trusted-ca\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776336 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-bound-sa-token\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776370 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-certificates\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776427 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-installation-pull-secrets\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776597 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776451 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776650 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776587 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-image-registry-private-configuration\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776650 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776633 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b353ecf-65d4-4f9e-8741-13aa18442556-ca-trust-extracted\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776754 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776682 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pwmf\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-kube-api-access-2pwmf\") pod \"3b353ecf-65d4-4f9e-8741-13aa18442556\" (UID: \"3b353ecf-65d4-4f9e-8741-13aa18442556\") " Jun 15 03:19:51.776754 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776703 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:51.776974 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.776849 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:19:51.777068 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.777029 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-trusted-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.777068 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.777048 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-certificates\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.778989 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.778891 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:51.779102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.779081 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:51.779171 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.779104 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:19:51.779225 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.779190 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-kube-api-access-2pwmf" (OuterVolumeSpecName: "kube-api-access-2pwmf") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "kube-api-access-2pwmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:19:51.779225 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.779208 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:19:51.787340 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.787318 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b353ecf-65d4-4f9e-8741-13aa18442556-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "3b353ecf-65d4-4f9e-8741-13aa18442556" (UID: "3b353ecf-65d4-4f9e-8741-13aa18442556"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:19:51.878351 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.878325 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-installation-pull-secrets\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.878351 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.878348 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-registry-tls\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.878495 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.878362 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/3b353ecf-65d4-4f9e-8741-13aa18442556-image-registry-private-configuration\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.878495 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.878372 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/3b353ecf-65d4-4f9e-8741-13aa18442556-ca-trust-extracted\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.878495 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.878381 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pwmf\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-kube-api-access-2pwmf\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.878495 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.878390 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3b353ecf-65d4-4f9e-8741-13aa18442556-bound-sa-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:19:51.998778 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:51.998752 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-757c745fb4-8585r"] Jun 15 03:19:52.002276 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:52.002253 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-757c745fb4-8585r"] Jun 15 03:19:52.016247 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:19:52.016225 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b353ecf-65d4-4f9e-8741-13aa18442556" path="/var/lib/kubelet/pods/3b353ecf-65d4-4f9e-8741-13aa18442556/volumes" Jun 15 03:20:00.681782 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.681718 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6f4dd7b5f6-bmpbs" podUID="f828cad4-224c-4780-910d-36b22cca5688" containerName="console" containerID="cri-o://4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6" gracePeriod=15 Jun 15 03:20:00.929355 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.929329 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:20:00.943837 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.943764 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-oauth-config\") pod \"f828cad4-224c-4780-910d-36b22cca5688\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " Jun 15 03:20:00.943837 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.943809 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-serving-cert\") pod \"f828cad4-224c-4780-910d-36b22cca5688\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " Jun 15 03:20:00.944062 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.943846 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-oauth-serving-cert\") pod \"f828cad4-224c-4780-910d-36b22cca5688\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " Jun 15 03:20:00.944062 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.943880 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-service-ca\") pod \"f828cad4-224c-4780-910d-36b22cca5688\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " Jun 15 03:20:00.944062 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.943919 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcpxj\" (UniqueName: \"kubernetes.io/projected/f828cad4-224c-4780-910d-36b22cca5688-kube-api-access-hcpxj\") pod \"f828cad4-224c-4780-910d-36b22cca5688\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " Jun 15 03:20:00.944062 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.944031 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-console-config\") pod \"f828cad4-224c-4780-910d-36b22cca5688\" (UID: \"f828cad4-224c-4780-910d-36b22cca5688\") " Jun 15 03:20:00.944279 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.944251 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f828cad4-224c-4780-910d-36b22cca5688" (UID: "f828cad4-224c-4780-910d-36b22cca5688"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:00.944520 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.944488 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-service-ca" (OuterVolumeSpecName: "service-ca") pod "f828cad4-224c-4780-910d-36b22cca5688" (UID: "f828cad4-224c-4780-910d-36b22cca5688"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:00.944621 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.944571 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-console-config" (OuterVolumeSpecName: "console-config") pod "f828cad4-224c-4780-910d-36b22cca5688" (UID: "f828cad4-224c-4780-910d-36b22cca5688"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:20:00.946713 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.946684 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f828cad4-224c-4780-910d-36b22cca5688-kube-api-access-hcpxj" (OuterVolumeSpecName: "kube-api-access-hcpxj") pod "f828cad4-224c-4780-910d-36b22cca5688" (UID: "f828cad4-224c-4780-910d-36b22cca5688"). InnerVolumeSpecName "kube-api-access-hcpxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:20:00.946811 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.946729 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f828cad4-224c-4780-910d-36b22cca5688" (UID: "f828cad4-224c-4780-910d-36b22cca5688"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:00.946811 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:00.946754 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f828cad4-224c-4780-910d-36b22cca5688" (UID: "f828cad4-224c-4780-910d-36b22cca5688"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:20:01.045353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.045316 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-console-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:20:01.045353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.045353 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-oauth-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:20:01.045548 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.045370 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f828cad4-224c-4780-910d-36b22cca5688-console-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:20:01.045548 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.045384 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-oauth-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:20:01.045548 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.045399 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f828cad4-224c-4780-910d-36b22cca5688-service-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:20:01.045548 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.045413 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcpxj\" (UniqueName: \"kubernetes.io/projected/f828cad4-224c-4780-910d-36b22cca5688-kube-api-access-hcpxj\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:20:01.717787 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.717757 2562 generic.go:356] "Generic (PLEG): container finished" podID="f828cad4-224c-4780-910d-36b22cca5688" containerID="4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6" exitCode=0 Jun 15 03:20:01.718262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.717804 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f4dd7b5f6-bmpbs" Jun 15 03:20:01.718262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.717838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dd7b5f6-bmpbs" event={"ID":"f828cad4-224c-4780-910d-36b22cca5688","Type":"ContainerDied","Data":"4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6"} Jun 15 03:20:01.718262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.717905 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f4dd7b5f6-bmpbs" event={"ID":"f828cad4-224c-4780-910d-36b22cca5688","Type":"ContainerDied","Data":"468bc9a231a73b39c2d184f768b491ce760a79862fa1efa210f486b525ca94a3"} Jun 15 03:20:01.718262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.717970 2562 scope.go:117] "RemoveContainer" containerID="4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6" Jun 15 03:20:01.730605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.730581 2562 scope.go:117] "RemoveContainer" containerID="4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6" Jun 15 03:20:01.731063 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:20:01.731035 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6\": container with ID starting with 4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6 not found: ID does not exist" containerID="4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6" Jun 15 03:20:01.731177 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.731073 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6"} err="failed to get container status \"4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6\": rpc error: code = NotFound desc = could not find container \"4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6\": container with ID starting with 4e2a4d0b07aadacb5095f5b6175777715c10fda9948ecfbc4275407696cbf7b6 not found: ID does not exist" Jun 15 03:20:01.744329 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.744294 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f4dd7b5f6-bmpbs"] Jun 15 03:20:01.748525 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:01.748494 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f4dd7b5f6-bmpbs"] Jun 15 03:20:02.016226 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:02.016146 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f828cad4-224c-4780-910d-36b22cca5688" path="/var/lib/kubelet/pods/f828cad4-224c-4780-910d-36b22cca5688/volumes" Jun 15 03:20:04.255645 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:04.255611 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:20:04.259394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:04.259365 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5c489ff7c5-z4g2w" Jun 15 03:20:09.749888 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:09.749809 2562 generic.go:356] "Generic (PLEG): container finished" podID="a6c99f55-bfb1-4e5c-bc36-77328f36133e" containerID="b54abf71628af001d088e75cdcdb6a9e3a45b71778110feff49b091a3749be6a" exitCode=0 Jun 15 03:20:09.750250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:09.749879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" event={"ID":"a6c99f55-bfb1-4e5c-bc36-77328f36133e","Type":"ContainerDied","Data":"b54abf71628af001d088e75cdcdb6a9e3a45b71778110feff49b091a3749be6a"} Jun 15 03:20:09.750250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:09.750180 2562 scope.go:117] "RemoveContainer" containerID="b54abf71628af001d088e75cdcdb6a9e3a45b71778110feff49b091a3749be6a" Jun 15 03:20:10.754999 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:10.754967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-274n7" event={"ID":"a6c99f55-bfb1-4e5c-bc36-77328f36133e","Type":"ContainerStarted","Data":"8ed681a7b12c1974a1c6c23cd9df4258fd9fa4f9cd15733640e53e3845420d39"} Jun 15 03:20:47.821884 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.821604 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74d46f657f-nrb9r"] Jun 15 03:20:47.822415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.822098 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b353ecf-65d4-4f9e-8741-13aa18442556" containerName="registry" Jun 15 03:20:47.822415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.822119 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b353ecf-65d4-4f9e-8741-13aa18442556" containerName="registry" Jun 15 03:20:47.822415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.822132 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f828cad4-224c-4780-910d-36b22cca5688" containerName="console" Jun 15 03:20:47.822415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.822140 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f828cad4-224c-4780-910d-36b22cca5688" containerName="console" Jun 15 03:20:47.822415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.822245 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f828cad4-224c-4780-910d-36b22cca5688" containerName="console" Jun 15 03:20:47.822415 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.822258 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b353ecf-65d4-4f9e-8741-13aa18442556" containerName="registry" Jun 15 03:20:47.825674 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.825653 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.835061 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.835039 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d46f657f-nrb9r"] Jun 15 03:20:47.917219 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917190 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-serving-cert\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.917364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-service-ca\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.917364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-oauth-serving-cert\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.917364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-oauth-config\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.917364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfpsx\" (UniqueName: \"kubernetes.io/projected/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-kube-api-access-nfpsx\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.917553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-trusted-ca-bundle\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:47.917553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:47.917453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-config\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018482 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018458 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-serving-cert\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018482 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-service-ca\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018681 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-oauth-serving-cert\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018681 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-oauth-config\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018795 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018707 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfpsx\" (UniqueName: \"kubernetes.io/projected/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-kube-api-access-nfpsx\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018795 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-trusted-ca-bundle\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.018892 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.018815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-config\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.019298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.019271 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-oauth-serving-cert\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.019473 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.019455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-service-ca\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.019554 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.019506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-config\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.019613 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.019583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-trusted-ca-bundle\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.021091 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.021071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-serving-cert\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.021211 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.021192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-oauth-config\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.025999 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.025976 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfpsx\" (UniqueName: \"kubernetes.io/projected/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-kube-api-access-nfpsx\") pod \"console-74d46f657f-nrb9r\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.136384 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.136356 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:48.269575 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.269543 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74d46f657f-nrb9r"] Jun 15 03:20:48.272828 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:20:48.272803 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d38ff6a_d5e8_4c30_8f35_694b8efb0a89.slice/crio-2e17400098031bd78eeb24b9e0368542c94a837a219f41852cde3241720bf30b WatchSource:0}: Error finding container 2e17400098031bd78eeb24b9e0368542c94a837a219f41852cde3241720bf30b: Status 404 returned error can't find the container with id 2e17400098031bd78eeb24b9e0368542c94a837a219f41852cde3241720bf30b Jun 15 03:20:48.904369 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.904329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d46f657f-nrb9r" event={"ID":"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89","Type":"ContainerStarted","Data":"bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167"} Jun 15 03:20:48.904848 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.904378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d46f657f-nrb9r" event={"ID":"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89","Type":"ContainerStarted","Data":"2e17400098031bd78eeb24b9e0368542c94a837a219f41852cde3241720bf30b"} Jun 15 03:20:48.922621 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:48.922572 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74d46f657f-nrb9r" podStartSLOduration=1.9225556849999998 podStartE2EDuration="1.922555685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:20:48.92071953 +0000 UTC m=+175.395654983" watchObservedRunningTime="2026-06-15 03:20:48.922555685 +0000 UTC m=+175.397491186" Jun 15 03:20:58.137478 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:58.137441 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:58.137869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:58.137500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:58.142267 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:58.142245 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:58.949712 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:58.949682 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:20:58.994320 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:20:58.994292 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58ffdc6dd6-8fpsk"] Jun 15 03:21:24.016996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.016925 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-58ffdc6dd6-8fpsk" podUID="2d3fb373-5cac-45da-a3b4-d8feb654acde" containerName="console" containerID="cri-o://90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57" gracePeriod=15 Jun 15 03:21:24.266048 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.266025 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:21:24.324914 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.324848 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-service-ca\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.324914 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.324892 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-oauth-serving-cert\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.324914 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.324911 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-oauth-config\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.325133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.324954 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-trusted-ca-bundle\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.325133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325002 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mc4xv\" (UniqueName: \"kubernetes.io/projected/2d3fb373-5cac-45da-a3b4-d8feb654acde-kube-api-access-mc4xv\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.325133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325063 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-config\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.325133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325099 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-serving-cert\") pod \"2d3fb373-5cac-45da-a3b4-d8feb654acde\" (UID: \"2d3fb373-5cac-45da-a3b4-d8feb654acde\") " Jun 15 03:21:24.325332 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325234 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:21:24.325486 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325457 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:21:24.325486 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325463 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-config" (OuterVolumeSpecName: "console-config") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:21:24.325486 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325475 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:21:24.325662 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.325510 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-service-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:24.327297 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.327271 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3fb373-5cac-45da-a3b4-d8feb654acde-kube-api-access-mc4xv" (OuterVolumeSpecName: "kube-api-access-mc4xv") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "kube-api-access-mc4xv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:21:24.327526 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.327504 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:21:24.327592 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.327528 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d3fb373-5cac-45da-a3b4-d8feb654acde" (UID: "2d3fb373-5cac-45da-a3b4-d8feb654acde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:21:24.426457 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.426415 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-oauth-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:24.426457 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.426449 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-oauth-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:24.426457 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.426459 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-trusted-ca-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:24.426693 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.426467 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mc4xv\" (UniqueName: \"kubernetes.io/projected/2d3fb373-5cac-45da-a3b4-d8feb654acde-kube-api-access-mc4xv\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:24.426693 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.426478 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:24.426693 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:24.426486 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d3fb373-5cac-45da-a3b4-d8feb654acde-console-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:21:25.051115 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.051079 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d3fb373-5cac-45da-a3b4-d8feb654acde" containerID="90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57" exitCode=0 Jun 15 03:21:25.051602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.051130 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58ffdc6dd6-8fpsk" Jun 15 03:21:25.051602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.051160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ffdc6dd6-8fpsk" event={"ID":"2d3fb373-5cac-45da-a3b4-d8feb654acde","Type":"ContainerDied","Data":"90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57"} Jun 15 03:21:25.051602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.051209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58ffdc6dd6-8fpsk" event={"ID":"2d3fb373-5cac-45da-a3b4-d8feb654acde","Type":"ContainerDied","Data":"cf6611a58cbfc9c66e7607c3319fd8e447739b557a82a0c384bb9fb777b69010"} Jun 15 03:21:25.051602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.051229 2562 scope.go:117] "RemoveContainer" containerID="90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57" Jun 15 03:21:25.060495 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.060478 2562 scope.go:117] "RemoveContainer" containerID="90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57" Jun 15 03:21:25.060856 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:21:25.060789 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57\": container with ID starting with 90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57 not found: ID does not exist" containerID="90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57" Jun 15 03:21:25.060856 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.060823 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57"} err="failed to get container status \"90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57\": rpc error: code = NotFound desc = could not find container \"90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57\": container with ID starting with 90e0a9fd2c0c204f27cde0ba77521a3d7a02e06888f8785078e3efab21a44d57 not found: ID does not exist" Jun 15 03:21:25.072596 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.072575 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-58ffdc6dd6-8fpsk"] Jun 15 03:21:25.078497 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:25.078477 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-58ffdc6dd6-8fpsk"] Jun 15 03:21:26.016499 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:21:26.016470 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d3fb373-5cac-45da-a3b4-d8feb654acde" path="/var/lib/kubelet/pods/2d3fb373-5cac-45da-a3b4-d8feb654acde/volumes" Jun 15 03:22:01.785237 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.785204 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5889d59f7-fzl6t"] Jun 15 03:22:01.785702 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.785613 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d3fb373-5cac-45da-a3b4-d8feb654acde" containerName="console" Jun 15 03:22:01.785702 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.785629 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d3fb373-5cac-45da-a3b4-d8feb654acde" containerName="console" Jun 15 03:22:01.785702 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.785688 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d3fb373-5cac-45da-a3b4-d8feb654acde" containerName="console" Jun 15 03:22:01.789806 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.789783 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.799785 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.799761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5889d59f7-fzl6t"] Jun 15 03:22:01.920226 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-service-ca\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.920420 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-oauth-config\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.920420 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920274 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-serving-cert\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.920420 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-oauth-serving-cert\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.920584 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-console-config\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.920584 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-trusted-ca-bundle\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:01.920584 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:01.920481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lzml\" (UniqueName: \"kubernetes.io/projected/a0963a03-232b-47b2-8c26-5631786d674e-kube-api-access-9lzml\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021225 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-oauth-serving-cert\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021389 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-console-config\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021389 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-trusted-ca-bundle\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021389 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lzml\" (UniqueName: \"kubernetes.io/projected/a0963a03-232b-47b2-8c26-5631786d674e-kube-api-access-9lzml\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021389 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-service-ca\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021389 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-oauth-config\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.021657 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.021406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-serving-cert\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.022058 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.022033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-oauth-serving-cert\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.022058 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.022051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-console-config\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.022245 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.022130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-service-ca\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.022327 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.022305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-trusted-ca-bundle\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.023770 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.023750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-oauth-config\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.023924 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.023907 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-serving-cert\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.029064 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.029045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lzml\" (UniqueName: \"kubernetes.io/projected/a0963a03-232b-47b2-8c26-5631786d674e-kube-api-access-9lzml\") pod \"console-5889d59f7-fzl6t\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.099768 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.099701 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:02.231609 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:02.231587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5889d59f7-fzl6t"] Jun 15 03:22:02.234162 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:22:02.234134 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0963a03_232b_47b2_8c26_5631786d674e.slice/crio-382a6572e4da7dc4507a52a13182806382f9b9266c813c153f50135c614b521c WatchSource:0}: Error finding container 382a6572e4da7dc4507a52a13182806382f9b9266c813c153f50135c614b521c: Status 404 returned error can't find the container with id 382a6572e4da7dc4507a52a13182806382f9b9266c813c153f50135c614b521c Jun 15 03:22:03.205105 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:03.205061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889d59f7-fzl6t" event={"ID":"a0963a03-232b-47b2-8c26-5631786d674e","Type":"ContainerStarted","Data":"bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2"} Jun 15 03:22:03.205478 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:03.205113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889d59f7-fzl6t" event={"ID":"a0963a03-232b-47b2-8c26-5631786d674e","Type":"ContainerStarted","Data":"382a6572e4da7dc4507a52a13182806382f9b9266c813c153f50135c614b521c"} Jun 15 03:22:03.225693 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:03.225648 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5889d59f7-fzl6t" podStartSLOduration=2.225631826 podStartE2EDuration="2.225631826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:22:03.223964742 +0000 UTC m=+249.698900196" watchObservedRunningTime="2026-06-15 03:22:03.225631826 +0000 UTC m=+249.700567335" Jun 15 03:22:12.100475 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:12.100423 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:12.100976 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:12.100505 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:12.105363 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:12.105341 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:12.240581 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:12.240549 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:22:12.283150 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:12.283117 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d46f657f-nrb9r"] Jun 15 03:22:37.307794 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.307749 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74d46f657f-nrb9r" podUID="9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" containerName="console" containerID="cri-o://bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167" gracePeriod=15 Jun 15 03:22:37.551912 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.551888 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:22:37.713573 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713542 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-serving-cert\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.713573 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713575 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-oauth-serving-cert\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.713766 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713591 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-config\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.713766 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713624 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfpsx\" (UniqueName: \"kubernetes.io/projected/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-kube-api-access-nfpsx\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.713845 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713758 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-oauth-config\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.713845 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713799 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-trusted-ca-bundle\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.713845 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.713833 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-service-ca\") pod \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\" (UID: \"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89\") " Jun 15 03:22:37.714049 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.714009 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-config" (OuterVolumeSpecName: "console-config") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:22:37.714135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.714050 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:22:37.714290 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.714263 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-oauth-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:37.714412 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.714297 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:37.714412 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.714261 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:22:37.714412 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.714289 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:22:37.715860 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.715834 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:22:37.715964 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.715891 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:22:37.716033 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.715962 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-kube-api-access-nfpsx" (OuterVolumeSpecName: "kube-api-access-nfpsx") pod "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" (UID: "9d38ff6a-d5e8-4c30-8f35-694b8efb0a89"). InnerVolumeSpecName "kube-api-access-nfpsx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:22:37.815529 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.815480 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:37.815529 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.815523 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfpsx\" (UniqueName: \"kubernetes.io/projected/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-kube-api-access-nfpsx\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:37.815529 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.815534 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-console-oauth-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:37.815529 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.815542 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-trusted-ca-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:37.815785 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:37.815551 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89-service-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:22:38.335553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.335463 2562 generic.go:356] "Generic (PLEG): container finished" podID="9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" containerID="bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167" exitCode=0 Jun 15 03:22:38.335553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.335500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d46f657f-nrb9r" event={"ID":"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89","Type":"ContainerDied","Data":"bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167"} Jun 15 03:22:38.335553 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.335529 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74d46f657f-nrb9r" Jun 15 03:22:38.336118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.335564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74d46f657f-nrb9r" event={"ID":"9d38ff6a-d5e8-4c30-8f35-694b8efb0a89","Type":"ContainerDied","Data":"2e17400098031bd78eeb24b9e0368542c94a837a219f41852cde3241720bf30b"} Jun 15 03:22:38.336118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.335587 2562 scope.go:117] "RemoveContainer" containerID="bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167" Jun 15 03:22:38.343311 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.343295 2562 scope.go:117] "RemoveContainer" containerID="bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167" Jun 15 03:22:38.343569 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:22:38.343551 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167\": container with ID starting with bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167 not found: ID does not exist" containerID="bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167" Jun 15 03:22:38.343624 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.343577 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167"} err="failed to get container status \"bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167\": rpc error: code = NotFound desc = could not find container \"bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167\": container with ID starting with bce3c13b6f651122e8d87a1ec757fb967cf675811a8cf933bf828ba20ce22167 not found: ID does not exist" Jun 15 03:22:38.350806 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.350782 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74d46f657f-nrb9r"] Jun 15 03:22:38.354559 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:38.354540 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74d46f657f-nrb9r"] Jun 15 03:22:40.016678 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:40.016647 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" path="/var/lib/kubelet/pods/9d38ff6a-d5e8-4c30-8f35-694b8efb0a89/volumes" Jun 15 03:22:53.947204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:53.947168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:22:53.950075 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:53.950050 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:22:53.958738 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:22:53.958713 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 03:23:40.911200 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.911165 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g"] Jun 15 03:23:40.911595 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.911452 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" containerName="console" Jun 15 03:23:40.911595 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.911462 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" containerName="console" Jun 15 03:23:40.911595 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.911529 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d38ff6a-d5e8-4c30-8f35-694b8efb0a89" containerName="console" Jun 15 03:23:40.914506 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.914486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:40.917008 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.916979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 03:23:40.917137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.917030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 03:23:40.917137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.917033 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 03:23:40.917324 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.917303 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 03:23:40.921626 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.921375 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rqg7g\"" Jun 15 03:23:40.937641 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:40.937619 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g"] Jun 15 03:23:41.009039 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.009010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06566df1-73a8-4a3d-a717-d75b67e3a232-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.009039 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.009042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv2zw\" (UniqueName: \"kubernetes.io/projected/06566df1-73a8-4a3d-a717-d75b67e3a232-kube-api-access-kv2zw\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.009220 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.009063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06566df1-73a8-4a3d-a717-d75b67e3a232-manifests\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.009220 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.009086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06566df1-73a8-4a3d-a717-d75b67e3a232-tmp\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.009220 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.009165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06566df1-73a8-4a3d-a717-d75b67e3a232-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.109643 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.109617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06566df1-73a8-4a3d-a717-d75b67e3a232-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.109779 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.109648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv2zw\" (UniqueName: \"kubernetes.io/projected/06566df1-73a8-4a3d-a717-d75b67e3a232-kube-api-access-kv2zw\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.109779 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.109684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06566df1-73a8-4a3d-a717-d75b67e3a232-manifests\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.109779 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.109699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06566df1-73a8-4a3d-a717-d75b67e3a232-tmp\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.109779 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.109730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06566df1-73a8-4a3d-a717-d75b67e3a232-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.110078 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.110030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/06566df1-73a8-4a3d-a717-d75b67e3a232-manifests\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.111972 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.111926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06566df1-73a8-4a3d-a717-d75b67e3a232-tmp\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.112104 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.112085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/06566df1-73a8-4a3d-a717-d75b67e3a232-webhook-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.112222 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.112205 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/06566df1-73a8-4a3d-a717-d75b67e3a232-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.117851 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.117827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv2zw\" (UniqueName: \"kubernetes.io/projected/06566df1-73a8-4a3d-a717-d75b67e3a232-kube-api-access-kv2zw\") pod \"opendatahub-operator-controller-manager-68fc7565bc-k245g\" (UID: \"06566df1-73a8-4a3d-a717-d75b67e3a232\") " pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.224907 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.224843 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:41.366463 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.366436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g"] Jun 15 03:23:41.369124 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:23:41.369097 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06566df1_73a8_4a3d_a717_d75b67e3a232.slice/crio-b26b519fefdf61025f1d9f5c57f312765bd4d64d9713993141658bf443457170 WatchSource:0}: Error finding container b26b519fefdf61025f1d9f5c57f312765bd4d64d9713993141658bf443457170: Status 404 returned error can't find the container with id b26b519fefdf61025f1d9f5c57f312765bd4d64d9713993141658bf443457170 Jun 15 03:23:41.370968 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.370951 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:23:41.575328 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:41.575247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" event={"ID":"06566df1-73a8-4a3d-a717-d75b67e3a232","Type":"ContainerStarted","Data":"b26b519fefdf61025f1d9f5c57f312765bd4d64d9713993141658bf443457170"} Jun 15 03:23:44.590735 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:44.590636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" event={"ID":"06566df1-73a8-4a3d-a717-d75b67e3a232","Type":"ContainerStarted","Data":"b1c08a1930489f08afee700041f6f9894001cd6667258afe4db09be3bdb74e16"} Jun 15 03:23:45.595956 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:45.595849 2562 generic.go:356] "Generic (PLEG): container finished" podID="06566df1-73a8-4a3d-a717-d75b67e3a232" containerID="b1c08a1930489f08afee700041f6f9894001cd6667258afe4db09be3bdb74e16" exitCode=0 Jun 15 03:23:45.596347 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:45.595953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" event={"ID":"06566df1-73a8-4a3d-a717-d75b67e3a232","Type":"ContainerDied","Data":"b1c08a1930489f08afee700041f6f9894001cd6667258afe4db09be3bdb74e16"} Jun 15 03:23:46.601607 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:46.601573 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" event={"ID":"06566df1-73a8-4a3d-a717-d75b67e3a232","Type":"ContainerStarted","Data":"f0cfb57598a34ab2df320dcef6f217f12f73929e8ea9d99ece9808f6aaeab1aa"} Jun 15 03:23:46.602001 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:46.601743 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:46.625048 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:46.625002 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" podStartSLOduration=2.365583494 podStartE2EDuration="6.624987968s" totalImagesPullingTime="3.319697208s" totalInitContainerRuntime="939.707266ms" isStatefulPod=false podCreationTimestamp="2026-06-15 03:23:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:23:46.624394404 +0000 UTC m=+353.099329860" watchObservedRunningTime="2026-06-15 03:23:46.624987968 +0000 UTC m=+353.099923422" Jun 15 03:23:57.607683 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:57.607647 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68fc7565bc-k245g" Jun 15 03:23:59.807318 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.807279 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79fc99d74-gzktx"] Jun 15 03:23:59.821123 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.821104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.825393 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.825369 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 03:23:59.825518 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.825465 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dbwk8\"" Jun 15 03:23:59.826094 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.826071 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 03:23:59.835814 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.835791 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79fc99d74-gzktx"] Jun 15 03:23:59.867192 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.867166 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rngb5\" (UniqueName: \"kubernetes.io/projected/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-kube-api-access-rngb5\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.867303 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.867204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-tls-certs\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.867303 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.867244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-tmp\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.968089 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.968061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rngb5\" (UniqueName: \"kubernetes.io/projected/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-kube-api-access-rngb5\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.968227 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.968110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-tls-certs\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.968227 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.968172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-tmp\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.970396 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.970374 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-tmp\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.970624 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.970603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-tls-certs\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:23:59.984922 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:23:59.984902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rngb5\" (UniqueName: \"kubernetes.io/projected/fa7911c0-6dc5-4056-9d17-3e46bf4ced3c-kube-api-access-rngb5\") pod \"kube-auth-proxy-79fc99d74-gzktx\" (UID: \"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c\") " pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:24:00.131038 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:00.131009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" Jun 15 03:24:00.257550 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:00.257476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79fc99d74-gzktx"] Jun 15 03:24:00.259730 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:24:00.259704 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa7911c0_6dc5_4056_9d17_3e46bf4ced3c.slice/crio-4d32f6c67734715a8cd9dd4ebffbfbf2f61b932eb91e0f4544a7d50d5fb82587 WatchSource:0}: Error finding container 4d32f6c67734715a8cd9dd4ebffbfbf2f61b932eb91e0f4544a7d50d5fb82587: Status 404 returned error can't find the container with id 4d32f6c67734715a8cd9dd4ebffbfbf2f61b932eb91e0f4544a7d50d5fb82587 Jun 15 03:24:00.660175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:00.660138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" event={"ID":"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c","Type":"ContainerStarted","Data":"4d32f6c67734715a8cd9dd4ebffbfbf2f61b932eb91e0f4544a7d50d5fb82587"} Jun 15 03:24:01.966303 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.966260 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf"] Jun 15 03:24:01.976260 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.976230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:01.979133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.978972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j7d7f\"" Jun 15 03:24:01.979133 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.978972 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 03:24:01.979360 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.979231 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 03:24:01.979360 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.979258 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 03:24:01.979360 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.979301 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 03:24:01.979523 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.979508 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 03:24:01.979582 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.979522 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf"] Jun 15 03:24:01.982533 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.982324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-manager-config\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:01.982533 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.982383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-metrics-cert\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:01.982533 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.982409 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6q7b\" (UniqueName: \"kubernetes.io/projected/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-kube-api-access-x6q7b\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:01.982533 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:01.982443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-cert\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.083146 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.083110 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-metrics-cert\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.083146 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.083150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6q7b\" (UniqueName: \"kubernetes.io/projected/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-kube-api-access-x6q7b\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.083392 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.083184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-cert\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.083392 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.083248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-manager-config\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.083917 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.083890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-manager-config\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.085918 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.085895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-cert\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.086027 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.085973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-metrics-cert\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.096388 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.096363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6q7b\" (UniqueName: \"kubernetes.io/projected/6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3-kube-api-access-x6q7b\") pod \"lws-controller-manager-94db46dd7-2pnnf\" (UID: \"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3\") " pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.291033 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.290941 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:02.983726 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:02.983699 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf"] Jun 15 03:24:02.987426 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:24:02.987399 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dfaa9d5_e183_4d3d_aaab_b8d71f83f1e3.slice/crio-10faf310ba5e075d119768845e238b09f973b518d620ea4de173d6dc40238ea7 WatchSource:0}: Error finding container 10faf310ba5e075d119768845e238b09f973b518d620ea4de173d6dc40238ea7: Status 404 returned error can't find the container with id 10faf310ba5e075d119768845e238b09f973b518d620ea4de173d6dc40238ea7 Jun 15 03:24:03.678144 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:03.678106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" event={"ID":"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3","Type":"ContainerStarted","Data":"10faf310ba5e075d119768845e238b09f973b518d620ea4de173d6dc40238ea7"} Jun 15 03:24:03.679509 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:03.679479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" event={"ID":"fa7911c0-6dc5-4056-9d17-3e46bf4ced3c","Type":"ContainerStarted","Data":"fc650ef22797ff7bedfb73039b2933f7db81c53edbff9188b0a660adcfa6c9e9"} Jun 15 03:24:03.696600 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:03.696552 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79fc99d74-gzktx" podStartSLOduration=2.043261316 podStartE2EDuration="4.696534454s" totalImagesPullingTime="2.653273138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:24:03.694588491 +0000 UTC m=+370.169523944" watchObservedRunningTime="2026-06-15 03:24:03.696534454 +0000 UTC m=+370.171469909" Jun 15 03:24:06.694425 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:06.694382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" event={"ID":"6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3","Type":"ContainerStarted","Data":"2ca910d476e54b5fa17c047cb87ce9d2377c4295bff748c31c8e91f9f46db61f"} Jun 15 03:24:06.694798 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:06.694461 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:24:06.710585 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:06.710538 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" podStartSLOduration=2.6036854419999997 podStartE2EDuration="5.710522922s" totalImagesPullingTime="3.10683748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:24:06.709134562 +0000 UTC m=+373.184070018" watchObservedRunningTime="2026-06-15 03:24:06.710522922 +0000 UTC m=+373.185458437" Jun 15 03:24:17.700780 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:24:17.700750 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-94db46dd7-2pnnf" Jun 15 03:25:48.667963 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.667917 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z"] Jun 15 03:25:48.671187 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.671171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.673227 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.673203 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 15 03:25:48.673353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.673262 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 03:25:48.673353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.673272 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 15 03:25:48.673353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.673308 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-mn44b\"" Jun 15 03:25:48.673796 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.673780 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 03:25:48.678335 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.678310 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z"] Jun 15 03:25:48.759357 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.759331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82e817fe-ca59-49bd-a833-d3e8c59e3e75-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.759502 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.759436 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e817fe-ca59-49bd-a833-d3e8c59e3e75-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.759502 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.759471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wlwv\" (UniqueName: \"kubernetes.io/projected/82e817fe-ca59-49bd-a833-d3e8c59e3e75-kube-api-access-4wlwv\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.860254 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.860226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82e817fe-ca59-49bd-a833-d3e8c59e3e75-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.860368 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.860291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e817fe-ca59-49bd-a833-d3e8c59e3e75-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.860368 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.860330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wlwv\" (UniqueName: \"kubernetes.io/projected/82e817fe-ca59-49bd-a833-d3e8c59e3e75-kube-api-access-4wlwv\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.860443 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:25:48.860430 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 15 03:25:48.860507 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:25:48.860497 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82e817fe-ca59-49bd-a833-d3e8c59e3e75-plugin-serving-cert podName:82e817fe-ca59-49bd-a833-d3e8c59e3e75 nodeName:}" failed. No retries permitted until 2026-06-15 03:25:49.360482274 +0000 UTC m=+475.835417706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/82e817fe-ca59-49bd-a833-d3e8c59e3e75-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-x8v2z" (UID: "82e817fe-ca59-49bd-a833-d3e8c59e3e75") : secret "plugin-serving-cert" not found Jun 15 03:25:48.860883 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.860865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/82e817fe-ca59-49bd-a833-d3e8c59e3e75-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:48.873969 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:48.873946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wlwv\" (UniqueName: \"kubernetes.io/projected/82e817fe-ca59-49bd-a833-d3e8c59e3e75-kube-api-access-4wlwv\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:49.364717 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:49.364675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e817fe-ca59-49bd-a833-d3e8c59e3e75-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:49.367154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:49.367130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/82e817fe-ca59-49bd-a833-d3e8c59e3e75-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-x8v2z\" (UID: \"82e817fe-ca59-49bd-a833-d3e8c59e3e75\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:49.581421 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:49.581388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" Jun 15 03:25:49.717112 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:49.717087 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z"] Jun 15 03:25:49.719396 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:25:49.719370 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82e817fe_ca59_49bd_a833_d3e8c59e3e75.slice/crio-c4aa06a676510ff12ca32312075b8231785f511f45b40d4f7942c5cc0c67dc26 WatchSource:0}: Error finding container c4aa06a676510ff12ca32312075b8231785f511f45b40d4f7942c5cc0c67dc26: Status 404 returned error can't find the container with id c4aa06a676510ff12ca32312075b8231785f511f45b40d4f7942c5cc0c67dc26 Jun 15 03:25:50.143410 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:25:50.143373 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" event={"ID":"82e817fe-ca59-49bd-a833-d3e8c59e3e75","Type":"ContainerStarted","Data":"c4aa06a676510ff12ca32312075b8231785f511f45b40d4f7942c5cc0c67dc26"} Jun 15 03:26:00.283762 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:00.283726 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5889d59f7-fzl6t"] Jun 15 03:26:14.267154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:14.267120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" event={"ID":"82e817fe-ca59-49bd-a833-d3e8c59e3e75","Type":"ContainerStarted","Data":"c95c3ef402c98ad8f6861b2dc42273449788f32ecac9a531381606fb869e5230"} Jun 15 03:26:14.283045 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:14.282998 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-x8v2z" podStartSLOduration=2.692310763 podStartE2EDuration="26.282979498s" totalImagesPullingTime="23.590668735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:26:14.282036959 +0000 UTC m=+500.756972416" watchObservedRunningTime="2026-06-15 03:26:14.282979498 +0000 UTC m=+500.757914952" Jun 15 03:26:25.311023 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.310982 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5889d59f7-fzl6t" podUID="a0963a03-232b-47b2-8c26-5631786d674e" containerName="console" containerID="cri-o://bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2" gracePeriod=15 Jun 15 03:26:25.561970 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.561885 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:26:25.694122 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694091 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-service-ca\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694122 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694126 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-oauth-serving-cert\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-oauth-config\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694177 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-trusted-ca-bundle\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694356 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694302 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lzml\" (UniqueName: \"kubernetes.io/projected/a0963a03-232b-47b2-8c26-5631786d674e-kube-api-access-9lzml\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694528 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694467 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-console-config\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694528 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694475 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:26:25.694528 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694512 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-serving-cert\") pod \"a0963a03-232b-47b2-8c26-5631786d674e\" (UID: \"a0963a03-232b-47b2-8c26-5631786d674e\") " Jun 15 03:26:25.694665 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694558 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:26:25.694725 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694612 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:26:25.694839 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694823 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-service-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:25.694877 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694847 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-oauth-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:25.694877 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694859 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-trusted-ca-bundle\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:25.694877 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.694816 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-console-config" (OuterVolumeSpecName: "console-config") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:26:25.696392 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.696364 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0963a03-232b-47b2-8c26-5631786d674e-kube-api-access-9lzml" (OuterVolumeSpecName: "kube-api-access-9lzml") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "kube-api-access-9lzml". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:26:25.696483 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.696410 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:26:25.696540 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.696488 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0963a03-232b-47b2-8c26-5631786d674e" (UID: "a0963a03-232b-47b2-8c26-5631786d674e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:26:25.796139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.796101 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-oauth-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:25.796139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.796131 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lzml\" (UniqueName: \"kubernetes.io/projected/a0963a03-232b-47b2-8c26-5631786d674e-kube-api-access-9lzml\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:25.796139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.796141 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0963a03-232b-47b2-8c26-5631786d674e-console-config\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:25.796139 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:25.796151 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0963a03-232b-47b2-8c26-5631786d674e-console-serving-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:26.316988 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.316887 2562 generic.go:356] "Generic (PLEG): container finished" podID="a0963a03-232b-47b2-8c26-5631786d674e" containerID="bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2" exitCode=0 Jun 15 03:26:26.316988 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.316945 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5889d59f7-fzl6t" Jun 15 03:26:26.316988 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.316974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889d59f7-fzl6t" event={"ID":"a0963a03-232b-47b2-8c26-5631786d674e","Type":"ContainerDied","Data":"bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2"} Jun 15 03:26:26.317540 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.317023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5889d59f7-fzl6t" event={"ID":"a0963a03-232b-47b2-8c26-5631786d674e","Type":"ContainerDied","Data":"382a6572e4da7dc4507a52a13182806382f9b9266c813c153f50135c614b521c"} Jun 15 03:26:26.317540 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.317043 2562 scope.go:117] "RemoveContainer" containerID="bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2" Jun 15 03:26:26.325170 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.325152 2562 scope.go:117] "RemoveContainer" containerID="bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2" Jun 15 03:26:26.325410 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:26:26.325393 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2\": container with ID starting with bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2 not found: ID does not exist" containerID="bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2" Jun 15 03:26:26.325448 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.325418 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2"} err="failed to get container status \"bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2\": rpc error: code = NotFound desc = could not find container \"bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2\": container with ID starting with bf2350a4a784a2a0a88d005883b3e559c2bc13889be95e8a7d09a0ae1c3585f2 not found: ID does not exist" Jun 15 03:26:26.332406 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.332381 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5889d59f7-fzl6t"] Jun 15 03:26:26.335883 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:26.335861 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5889d59f7-fzl6t"] Jun 15 03:26:28.017343 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:28.017311 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0963a03-232b-47b2-8c26-5631786d674e" path="/var/lib/kubelet/pods/a0963a03-232b-47b2-8c26-5631786d674e/volumes" Jun 15 03:26:30.653146 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.653113 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:26:30.653524 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.653434 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0963a03-232b-47b2-8c26-5631786d674e" containerName="console" Jun 15 03:26:30.653524 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.653444 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0963a03-232b-47b2-8c26-5631786d674e" containerName="console" Jun 15 03:26:30.653524 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.653497 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0963a03-232b-47b2-8c26-5631786d674e" containerName="console" Jun 15 03:26:30.657922 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.657905 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.659795 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.659770 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 03:26:30.665515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.665493 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:26:30.696274 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.696234 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:26:30.734123 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.734087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbg7t\" (UniqueName: \"kubernetes.io/projected/48a50196-c99b-4571-9bb5-b178e9eb01d5-kube-api-access-cbg7t\") pod \"limitador-limitador-54d6d988d5-tl9mr\" (UID: \"48a50196-c99b-4571-9bb5-b178e9eb01d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.734251 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.734132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/48a50196-c99b-4571-9bb5-b178e9eb01d5-config-file\") pod \"limitador-limitador-54d6d988d5-tl9mr\" (UID: \"48a50196-c99b-4571-9bb5-b178e9eb01d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.835213 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.835170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbg7t\" (UniqueName: \"kubernetes.io/projected/48a50196-c99b-4571-9bb5-b178e9eb01d5-kube-api-access-cbg7t\") pod \"limitador-limitador-54d6d988d5-tl9mr\" (UID: \"48a50196-c99b-4571-9bb5-b178e9eb01d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.835405 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.835220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/48a50196-c99b-4571-9bb5-b178e9eb01d5-config-file\") pod \"limitador-limitador-54d6d988d5-tl9mr\" (UID: \"48a50196-c99b-4571-9bb5-b178e9eb01d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.835908 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.835888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/48a50196-c99b-4571-9bb5-b178e9eb01d5-config-file\") pod \"limitador-limitador-54d6d988d5-tl9mr\" (UID: \"48a50196-c99b-4571-9bb5-b178e9eb01d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.843025 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.842995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbg7t\" (UniqueName: \"kubernetes.io/projected/48a50196-c99b-4571-9bb5-b178e9eb01d5-kube-api-access-cbg7t\") pod \"limitador-limitador-54d6d988d5-tl9mr\" (UID: \"48a50196-c99b-4571-9bb5-b178e9eb01d5\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:30.967811 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:30.967726 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:31.096380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.096353 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:26:31.100043 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:26:31.100013 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48a50196_c99b_4571_9bb5_b178e9eb01d5.slice/crio-5ffb83d837a323ab9041de3432a5e3d8f3ffdc009dc36f6492d0855ef4094062 WatchSource:0}: Error finding container 5ffb83d837a323ab9041de3432a5e3d8f3ffdc009dc36f6492d0855ef4094062: Status 404 returned error can't find the container with id 5ffb83d837a323ab9041de3432a5e3d8f3ffdc009dc36f6492d0855ef4094062 Jun 15 03:26:31.107517 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.107493 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-cxznj"] Jun 15 03:26:31.112042 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.112024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:31.113855 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.113836 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-z72cg\"" Jun 15 03:26:31.116411 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.116389 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cxznj"] Jun 15 03:26:31.137013 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.136986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rsxn\" (UniqueName: \"kubernetes.io/projected/a15fbb73-5c19-4420-8e0c-b7dd372e732e-kube-api-access-8rsxn\") pod \"authorino-58cd955675-cxznj\" (UID: \"a15fbb73-5c19-4420-8e0c-b7dd372e732e\") " pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:31.237511 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.237443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rsxn\" (UniqueName: \"kubernetes.io/projected/a15fbb73-5c19-4420-8e0c-b7dd372e732e-kube-api-access-8rsxn\") pod \"authorino-58cd955675-cxznj\" (UID: \"a15fbb73-5c19-4420-8e0c-b7dd372e732e\") " pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:31.245486 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.245462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rsxn\" (UniqueName: \"kubernetes.io/projected/a15fbb73-5c19-4420-8e0c-b7dd372e732e-kube-api-access-8rsxn\") pod \"authorino-58cd955675-cxznj\" (UID: \"a15fbb73-5c19-4420-8e0c-b7dd372e732e\") " pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:31.275691 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.275661 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cdgpf"] Jun 15 03:26:31.278917 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.278900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:26:31.286250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.286230 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cdgpf"] Jun 15 03:26:31.338224 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.338204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwfsb\" (UniqueName: \"kubernetes.io/projected/cf8c2c25-984f-449e-88db-ce325c8e8cfd-kube-api-access-pwfsb\") pod \"authorino-75d556bd77-cdgpf\" (UID: \"cf8c2c25-984f-449e-88db-ce325c8e8cfd\") " pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:26:31.340151 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.340127 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" event={"ID":"48a50196-c99b-4571-9bb5-b178e9eb01d5","Type":"ContainerStarted","Data":"5ffb83d837a323ab9041de3432a5e3d8f3ffdc009dc36f6492d0855ef4094062"} Jun 15 03:26:31.422640 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.422620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:31.438668 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.438646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwfsb\" (UniqueName: \"kubernetes.io/projected/cf8c2c25-984f-449e-88db-ce325c8e8cfd-kube-api-access-pwfsb\") pod \"authorino-75d556bd77-cdgpf\" (UID: \"cf8c2c25-984f-449e-88db-ce325c8e8cfd\") " pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:26:31.448082 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.448055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwfsb\" (UniqueName: \"kubernetes.io/projected/cf8c2c25-984f-449e-88db-ce325c8e8cfd-kube-api-access-pwfsb\") pod \"authorino-75d556bd77-cdgpf\" (UID: \"cf8c2c25-984f-449e-88db-ce325c8e8cfd\") " pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:26:31.581678 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.581643 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-cxznj"] Jun 15 03:26:31.588421 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:26:31.588388 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda15fbb73_5c19_4420_8e0c_b7dd372e732e.slice/crio-fad4d799bf69a4d544f65884d643c6a484e61a0154d2719a6258bb0ba2fbe7c1 WatchSource:0}: Error finding container fad4d799bf69a4d544f65884d643c6a484e61a0154d2719a6258bb0ba2fbe7c1: Status 404 returned error can't find the container with id fad4d799bf69a4d544f65884d643c6a484e61a0154d2719a6258bb0ba2fbe7c1 Jun 15 03:26:31.588535 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.588422 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:26:31.770262 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:31.770177 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cdgpf"] Jun 15 03:26:31.773139 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:26:31.773112 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf8c2c25_984f_449e_88db_ce325c8e8cfd.slice/crio-f54c692dc261faae76a8396a25689a1ee7d6122e277c29756f36c4bad23b178f WatchSource:0}: Error finding container f54c692dc261faae76a8396a25689a1ee7d6122e277c29756f36c4bad23b178f: Status 404 returned error can't find the container with id f54c692dc261faae76a8396a25689a1ee7d6122e277c29756f36c4bad23b178f Jun 15 03:26:32.353802 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:32.353760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cdgpf" event={"ID":"cf8c2c25-984f-449e-88db-ce325c8e8cfd","Type":"ContainerStarted","Data":"f54c692dc261faae76a8396a25689a1ee7d6122e277c29756f36c4bad23b178f"} Jun 15 03:26:32.358455 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:32.358426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cxznj" event={"ID":"a15fbb73-5c19-4420-8e0c-b7dd372e732e","Type":"ContainerStarted","Data":"fad4d799bf69a4d544f65884d643c6a484e61a0154d2719a6258bb0ba2fbe7c1"} Jun 15 03:26:36.381616 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.381581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" event={"ID":"48a50196-c99b-4571-9bb5-b178e9eb01d5","Type":"ContainerStarted","Data":"405512ffe6104d7a3d339d95c619cc63ee0a2ae06cf956e321b080eb2379ed90"} Jun 15 03:26:36.382097 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.381762 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:26:36.383093 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.383067 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cdgpf" event={"ID":"cf8c2c25-984f-449e-88db-ce325c8e8cfd","Type":"ContainerStarted","Data":"b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99"} Jun 15 03:26:36.384486 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.384463 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cxznj" event={"ID":"a15fbb73-5c19-4420-8e0c-b7dd372e732e","Type":"ContainerStarted","Data":"e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04"} Jun 15 03:26:36.396967 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.396860 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" podStartSLOduration=1.502368014 podStartE2EDuration="6.396846923s" totalImagesPullingTime="4.894478909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:26:36.396230979 +0000 UTC m=+522.871166437" watchObservedRunningTime="2026-06-15 03:26:36.396846923 +0000 UTC m=+522.871782378" Jun 15 03:26:36.410240 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.410201 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cdgpf" podStartSLOduration=1.2341267280000001 podStartE2EDuration="5.410188665s" totalImagesPullingTime="4.176061937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:26:36.408526215 +0000 UTC m=+522.883461671" watchObservedRunningTime="2026-06-15 03:26:36.410188665 +0000 UTC m=+522.885124118" Jun 15 03:26:36.426430 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.426391 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-cxznj" podStartSLOduration=1.026378957 podStartE2EDuration="5.426378523s" totalImagesPullingTime="4.399999566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:26:36.425130966 +0000 UTC m=+522.900066420" watchObservedRunningTime="2026-06-15 03:26:36.426378523 +0000 UTC m=+522.901313977" Jun 15 03:26:36.438172 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:36.438148 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cxznj"] Jun 15 03:26:38.399997 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:38.399911 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-cxznj" podUID="a15fbb73-5c19-4420-8e0c-b7dd372e732e" containerName="authorino" containerID="cri-o://e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04" gracePeriod=30 Jun 15 03:26:38.643281 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:38.643256 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:38.688691 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:38.688628 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rsxn\" (UniqueName: \"kubernetes.io/projected/a15fbb73-5c19-4420-8e0c-b7dd372e732e-kube-api-access-8rsxn\") pod \"a15fbb73-5c19-4420-8e0c-b7dd372e732e\" (UID: \"a15fbb73-5c19-4420-8e0c-b7dd372e732e\") " Jun 15 03:26:38.690616 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:38.690595 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a15fbb73-5c19-4420-8e0c-b7dd372e732e-kube-api-access-8rsxn" (OuterVolumeSpecName: "kube-api-access-8rsxn") pod "a15fbb73-5c19-4420-8e0c-b7dd372e732e" (UID: "a15fbb73-5c19-4420-8e0c-b7dd372e732e"). InnerVolumeSpecName "kube-api-access-8rsxn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:26:38.789548 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:38.789520 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rsxn\" (UniqueName: \"kubernetes.io/projected/a15fbb73-5c19-4420-8e0c-b7dd372e732e-kube-api-access-8rsxn\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:26:39.405690 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.405654 2562 generic.go:356] "Generic (PLEG): container finished" podID="a15fbb73-5c19-4420-8e0c-b7dd372e732e" containerID="e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04" exitCode=0 Jun 15 03:26:39.406204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.405700 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-cxznj" Jun 15 03:26:39.406204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.405747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cxznj" event={"ID":"a15fbb73-5c19-4420-8e0c-b7dd372e732e","Type":"ContainerDied","Data":"e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04"} Jun 15 03:26:39.406204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.405792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-cxznj" event={"ID":"a15fbb73-5c19-4420-8e0c-b7dd372e732e","Type":"ContainerDied","Data":"fad4d799bf69a4d544f65884d643c6a484e61a0154d2719a6258bb0ba2fbe7c1"} Jun 15 03:26:39.406204 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.405810 2562 scope.go:117] "RemoveContainer" containerID="e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04" Jun 15 03:26:39.414190 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.414174 2562 scope.go:117] "RemoveContainer" containerID="e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04" Jun 15 03:26:39.414437 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:26:39.414417 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04\": container with ID starting with e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04 not found: ID does not exist" containerID="e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04" Jun 15 03:26:39.414534 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.414443 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04"} err="failed to get container status \"e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04\": rpc error: code = NotFound desc = could not find container \"e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04\": container with ID starting with e3aa1be4fb235ebb67d41367a2fd5a1cd17c5074859cdd6099b6140d5573fe04 not found: ID does not exist" Jun 15 03:26:39.425651 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.425626 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-cxznj"] Jun 15 03:26:39.429406 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:39.429385 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-cxznj"] Jun 15 03:26:40.016821 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:40.016792 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a15fbb73-5c19-4420-8e0c-b7dd372e732e" path="/var/lib/kubelet/pods/a15fbb73-5c19-4420-8e0c-b7dd372e732e/volumes" Jun 15 03:26:47.392090 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:26:47.392006 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-tl9mr" Jun 15 03:27:53.975924 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:27:53.975899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:27:53.975924 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:27:53.975923 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:28:01.747596 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.747558 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z649x"] Jun 15 03:28:01.748022 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.747911 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a15fbb73-5c19-4420-8e0c-b7dd372e732e" containerName="authorino" Jun 15 03:28:01.748022 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.747924 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a15fbb73-5c19-4420-8e0c-b7dd372e732e" containerName="authorino" Jun 15 03:28:01.748022 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.748006 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a15fbb73-5c19-4420-8e0c-b7dd372e732e" containerName="authorino" Jun 15 03:28:01.750912 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.750897 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:01.756350 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.756328 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z649x"] Jun 15 03:28:01.866861 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.866832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p556m\" (UniqueName: \"kubernetes.io/projected/7d854310-a68e-4df3-ac8a-bf025791fd4c-kube-api-access-p556m\") pod \"authorino-5d4b67c446-z649x\" (UID: \"7d854310-a68e-4df3-ac8a-bf025791fd4c\") " pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:01.967993 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.967955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p556m\" (UniqueName: \"kubernetes.io/projected/7d854310-a68e-4df3-ac8a-bf025791fd4c-kube-api-access-p556m\") pod \"authorino-5d4b67c446-z649x\" (UID: \"7d854310-a68e-4df3-ac8a-bf025791fd4c\") " pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:01.972847 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.972814 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z649x"] Jun 15 03:28:01.973077 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:28:01.973054 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-p556m], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-z649x" podUID="7d854310-a68e-4df3-ac8a-bf025791fd4c" Jun 15 03:28:01.975744 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:01.975721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p556m\" (UniqueName: \"kubernetes.io/projected/7d854310-a68e-4df3-ac8a-bf025791fd4c-kube-api-access-p556m\") pod \"authorino-5d4b67c446-z649x\" (UID: \"7d854310-a68e-4df3-ac8a-bf025791fd4c\") " pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:02.002278 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.002222 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68cc64d677-t7frz"] Jun 15 03:28:02.005540 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.005525 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:02.017111 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.017092 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68cc64d677-t7frz"] Jun 15 03:28:02.069042 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.069012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtltk\" (UniqueName: \"kubernetes.io/projected/bf9e7c2c-f9f4-48dc-9e58-72f03d662661-kube-api-access-jtltk\") pod \"authorino-68cc64d677-t7frz\" (UID: \"bf9e7c2c-f9f4-48dc-9e58-72f03d662661\") " pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:02.070467 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.070449 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68cc64d677-t7frz"] Jun 15 03:28:02.070692 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:28:02.070663 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jtltk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-68cc64d677-t7frz" podUID="bf9e7c2c-f9f4-48dc-9e58-72f03d662661" Jun 15 03:28:02.102948 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.102905 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b9d9c958f-bt468"] Jun 15 03:28:02.106111 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.106093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.108177 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.108155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 03:28:02.113357 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.113334 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9d9c958f-bt468"] Jun 15 03:28:02.169986 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.169964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7415f72c-72fd-47e3-9001-be657fe2d28b-tls-cert\") pod \"authorino-7b9d9c958f-bt468\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.170106 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.170002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2r4s\" (UniqueName: \"kubernetes.io/projected/7415f72c-72fd-47e3-9001-be657fe2d28b-kube-api-access-r2r4s\") pod \"authorino-7b9d9c958f-bt468\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.170106 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.170029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtltk\" (UniqueName: \"kubernetes.io/projected/bf9e7c2c-f9f4-48dc-9e58-72f03d662661-kube-api-access-jtltk\") pod \"authorino-68cc64d677-t7frz\" (UID: \"bf9e7c2c-f9f4-48dc-9e58-72f03d662661\") " pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:02.180826 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.180807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtltk\" (UniqueName: \"kubernetes.io/projected/bf9e7c2c-f9f4-48dc-9e58-72f03d662661-kube-api-access-jtltk\") pod \"authorino-68cc64d677-t7frz\" (UID: \"bf9e7c2c-f9f4-48dc-9e58-72f03d662661\") " pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:02.270952 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.270861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7415f72c-72fd-47e3-9001-be657fe2d28b-tls-cert\") pod \"authorino-7b9d9c958f-bt468\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.270952 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.270902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2r4s\" (UniqueName: \"kubernetes.io/projected/7415f72c-72fd-47e3-9001-be657fe2d28b-kube-api-access-r2r4s\") pod \"authorino-7b9d9c958f-bt468\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.273102 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.273080 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7415f72c-72fd-47e3-9001-be657fe2d28b-tls-cert\") pod \"authorino-7b9d9c958f-bt468\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.278154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.278131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2r4s\" (UniqueName: \"kubernetes.io/projected/7415f72c-72fd-47e3-9001-be657fe2d28b-kube-api-access-r2r4s\") pod \"authorino-7b9d9c958f-bt468\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.415201 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.415172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:28:02.540089 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.540022 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b9d9c958f-bt468"] Jun 15 03:28:02.768515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.768478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9d9c958f-bt468" event={"ID":"7415f72c-72fd-47e3-9001-be657fe2d28b","Type":"ContainerStarted","Data":"5ad4ad5a89bc9407837614fefbf70cca2bbf37662c0330760667b7e07c4d93f3"} Jun 15 03:28:02.768515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.768507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:02.768515 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.768498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:02.776569 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.776548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:02.778717 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.778703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:02.876359 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.876328 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p556m\" (UniqueName: \"kubernetes.io/projected/7d854310-a68e-4df3-ac8a-bf025791fd4c-kube-api-access-p556m\") pod \"7d854310-a68e-4df3-ac8a-bf025791fd4c\" (UID: \"7d854310-a68e-4df3-ac8a-bf025791fd4c\") " Jun 15 03:28:02.876516 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.876371 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtltk\" (UniqueName: \"kubernetes.io/projected/bf9e7c2c-f9f4-48dc-9e58-72f03d662661-kube-api-access-jtltk\") pod \"bf9e7c2c-f9f4-48dc-9e58-72f03d662661\" (UID: \"bf9e7c2c-f9f4-48dc-9e58-72f03d662661\") " Jun 15 03:28:02.878546 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.878523 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf9e7c2c-f9f4-48dc-9e58-72f03d662661-kube-api-access-jtltk" (OuterVolumeSpecName: "kube-api-access-jtltk") pod "bf9e7c2c-f9f4-48dc-9e58-72f03d662661" (UID: "bf9e7c2c-f9f4-48dc-9e58-72f03d662661"). InnerVolumeSpecName "kube-api-access-jtltk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:28:02.878611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.878558 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d854310-a68e-4df3-ac8a-bf025791fd4c-kube-api-access-p556m" (OuterVolumeSpecName: "kube-api-access-p556m") pod "7d854310-a68e-4df3-ac8a-bf025791fd4c" (UID: "7d854310-a68e-4df3-ac8a-bf025791fd4c"). InnerVolumeSpecName "kube-api-access-p556m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:28:02.977858 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.977835 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p556m\" (UniqueName: \"kubernetes.io/projected/7d854310-a68e-4df3-ac8a-bf025791fd4c-kube-api-access-p556m\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:28:02.977858 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:02.977858 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtltk\" (UniqueName: \"kubernetes.io/projected/bf9e7c2c-f9f4-48dc-9e58-72f03d662661-kube-api-access-jtltk\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:28:03.774464 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.774423 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9d9c958f-bt468" event={"ID":"7415f72c-72fd-47e3-9001-be657fe2d28b","Type":"ContainerStarted","Data":"5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b"} Jun 15 03:28:03.774852 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.774539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-z649x" Jun 15 03:28:03.774852 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.774613 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68cc64d677-t7frz" Jun 15 03:28:03.790227 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.790191 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b9d9c958f-bt468" podStartSLOduration=1.401084012 podStartE2EDuration="1.790178867s" totalImagesPullingTime="389.094855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:28:03.78909359 +0000 UTC m=+610.264029045" watchObservedRunningTime="2026-06-15 03:28:03.790178867 +0000 UTC m=+610.265114320" Jun 15 03:28:03.812013 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.811978 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68cc64d677-t7frz"] Jun 15 03:28:03.817334 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.817312 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68cc64d677-t7frz"] Jun 15 03:28:03.821506 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.821484 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cdgpf"] Jun 15 03:28:03.821654 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.821635 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cdgpf" podUID="cf8c2c25-984f-449e-88db-ce325c8e8cfd" containerName="authorino" containerID="cri-o://b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99" gracePeriod=30 Jun 15 03:28:03.841742 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.841720 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z649x"] Jun 15 03:28:03.847259 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:03.847237 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-z649x"] Jun 15 03:28:04.016685 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.016648 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d854310-a68e-4df3-ac8a-bf025791fd4c" path="/var/lib/kubelet/pods/7d854310-a68e-4df3-ac8a-bf025791fd4c/volumes" Jun 15 03:28:04.016868 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.016855 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9e7c2c-f9f4-48dc-9e58-72f03d662661" path="/var/lib/kubelet/pods/bf9e7c2c-f9f4-48dc-9e58-72f03d662661/volumes" Jun 15 03:28:04.069958 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.069922 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:28:04.188544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.188517 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwfsb\" (UniqueName: \"kubernetes.io/projected/cf8c2c25-984f-449e-88db-ce325c8e8cfd-kube-api-access-pwfsb\") pod \"cf8c2c25-984f-449e-88db-ce325c8e8cfd\" (UID: \"cf8c2c25-984f-449e-88db-ce325c8e8cfd\") " Jun 15 03:28:04.190546 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.190520 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf8c2c25-984f-449e-88db-ce325c8e8cfd-kube-api-access-pwfsb" (OuterVolumeSpecName: "kube-api-access-pwfsb") pod "cf8c2c25-984f-449e-88db-ce325c8e8cfd" (UID: "cf8c2c25-984f-449e-88db-ce325c8e8cfd"). InnerVolumeSpecName "kube-api-access-pwfsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:28:04.289682 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.289656 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwfsb\" (UniqueName: \"kubernetes.io/projected/cf8c2c25-984f-449e-88db-ce325c8e8cfd-kube-api-access-pwfsb\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:28:04.779600 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.779563 2562 generic.go:356] "Generic (PLEG): container finished" podID="cf8c2c25-984f-449e-88db-ce325c8e8cfd" containerID="b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99" exitCode=0 Jun 15 03:28:04.780085 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.779619 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cdgpf" Jun 15 03:28:04.780085 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.779640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cdgpf" event={"ID":"cf8c2c25-984f-449e-88db-ce325c8e8cfd","Type":"ContainerDied","Data":"b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99"} Jun 15 03:28:04.780085 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.779676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cdgpf" event={"ID":"cf8c2c25-984f-449e-88db-ce325c8e8cfd","Type":"ContainerDied","Data":"f54c692dc261faae76a8396a25689a1ee7d6122e277c29756f36c4bad23b178f"} Jun 15 03:28:04.780085 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.779693 2562 scope.go:117] "RemoveContainer" containerID="b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99" Jun 15 03:28:04.788175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.788158 2562 scope.go:117] "RemoveContainer" containerID="b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99" Jun 15 03:28:04.788454 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:28:04.788438 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99\": container with ID starting with b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99 not found: ID does not exist" containerID="b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99" Jun 15 03:28:04.788505 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.788463 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99"} err="failed to get container status \"b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99\": rpc error: code = NotFound desc = could not find container \"b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99\": container with ID starting with b6a924a1ad8e1c4b8d692e8788b094dc6f109ced68b5c5c10bc376ed1fe83c99 not found: ID does not exist" Jun 15 03:28:04.798732 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.798702 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cdgpf"] Jun 15 03:28:04.802301 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:04.802281 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cdgpf"] Jun 15 03:28:06.016678 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:06.016650 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf8c2c25-984f-449e-88db-ce325c8e8cfd" path="/var/lib/kubelet/pods/cf8c2c25-984f-449e-88db-ce325c8e8cfd/volumes" Jun 15 03:28:42.973151 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:28:42.973111 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:29:31.262047 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.262014 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-578bd54477-tz4hd"] Jun 15 03:29:31.262733 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.262335 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf8c2c25-984f-449e-88db-ce325c8e8cfd" containerName="authorino" Jun 15 03:29:31.262733 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.262346 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf8c2c25-984f-449e-88db-ce325c8e8cfd" containerName="authorino" Jun 15 03:29:31.262733 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.262394 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf8c2c25-984f-449e-88db-ce325c8e8cfd" containerName="authorino" Jun 15 03:29:31.265352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.265335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.267482 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.267461 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 03:29:31.274137 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.274115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-578bd54477-tz4hd"] Jun 15 03:29:31.322971 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.322912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bded5bb1-0415-4b71-a894-c159da75d953-oidc-ca\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.322971 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.322970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmd4\" (UniqueName: \"kubernetes.io/projected/bded5bb1-0415-4b71-a894-c159da75d953-kube-api-access-vhmd4\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.323136 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.323041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bded5bb1-0415-4b71-a894-c159da75d953-tls-cert\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.424085 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.424057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bded5bb1-0415-4b71-a894-c159da75d953-tls-cert\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.424244 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.424126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bded5bb1-0415-4b71-a894-c159da75d953-oidc-ca\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.424244 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.424154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmd4\" (UniqueName: \"kubernetes.io/projected/bded5bb1-0415-4b71-a894-c159da75d953-kube-api-access-vhmd4\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.424791 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.424770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bded5bb1-0415-4b71-a894-c159da75d953-oidc-ca\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.426516 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.426496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bded5bb1-0415-4b71-a894-c159da75d953-tls-cert\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.435277 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.435256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmd4\" (UniqueName: \"kubernetes.io/projected/bded5bb1-0415-4b71-a894-c159da75d953-kube-api-access-vhmd4\") pod \"authorino-578bd54477-tz4hd\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.574442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.574365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:29:31.700035 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.700011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-578bd54477-tz4hd"] Jun 15 03:29:31.702767 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:29:31.702742 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbded5bb1_0415_4b71_a894_c159da75d953.slice/crio-590d416c72aa4d035ceaa718daeea2f9ea22eebb3e5bdce58f9104bea4ea8c5d WatchSource:0}: Error finding container 590d416c72aa4d035ceaa718daeea2f9ea22eebb3e5bdce58f9104bea4ea8c5d: Status 404 returned error can't find the container with id 590d416c72aa4d035ceaa718daeea2f9ea22eebb3e5bdce58f9104bea4ea8c5d Jun 15 03:29:31.704462 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:31.704447 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:29:32.157715 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.157676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-578bd54477-tz4hd" event={"ID":"bded5bb1-0415-4b71-a894-c159da75d953","Type":"ContainerStarted","Data":"16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018"} Jun 15 03:29:32.157883 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.157729 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-578bd54477-tz4hd" event={"ID":"bded5bb1-0415-4b71-a894-c159da75d953","Type":"ContainerStarted","Data":"590d416c72aa4d035ceaa718daeea2f9ea22eebb3e5bdce58f9104bea4ea8c5d"} Jun 15 03:29:32.174347 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.174293 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-578bd54477-tz4hd" podStartSLOduration=0.851181511 podStartE2EDuration="1.174277705s" totalImagesPullingTime="323.096194ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:29:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:29:32.17262331 +0000 UTC m=+698.647558765" watchObservedRunningTime="2026-06-15 03:29:32.174277705 +0000 UTC m=+698.649213159" Jun 15 03:29:32.201725 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.201688 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9d9c958f-bt468"] Jun 15 03:29:32.201887 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.201867 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7b9d9c958f-bt468" podUID="7415f72c-72fd-47e3-9001-be657fe2d28b" containerName="authorino" containerID="cri-o://5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b" gracePeriod=30 Jun 15 03:29:32.441079 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.441054 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:29:32.534151 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.534123 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7415f72c-72fd-47e3-9001-be657fe2d28b-tls-cert\") pod \"7415f72c-72fd-47e3-9001-be657fe2d28b\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " Jun 15 03:29:32.534294 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.534196 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2r4s\" (UniqueName: \"kubernetes.io/projected/7415f72c-72fd-47e3-9001-be657fe2d28b-kube-api-access-r2r4s\") pod \"7415f72c-72fd-47e3-9001-be657fe2d28b\" (UID: \"7415f72c-72fd-47e3-9001-be657fe2d28b\") " Jun 15 03:29:32.536249 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.536223 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7415f72c-72fd-47e3-9001-be657fe2d28b-kube-api-access-r2r4s" (OuterVolumeSpecName: "kube-api-access-r2r4s") pod "7415f72c-72fd-47e3-9001-be657fe2d28b" (UID: "7415f72c-72fd-47e3-9001-be657fe2d28b"). InnerVolumeSpecName "kube-api-access-r2r4s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:29:32.543979 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.543955 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7415f72c-72fd-47e3-9001-be657fe2d28b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "7415f72c-72fd-47e3-9001-be657fe2d28b" (UID: "7415f72c-72fd-47e3-9001-be657fe2d28b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:29:32.635237 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.635197 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7415f72c-72fd-47e3-9001-be657fe2d28b-tls-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:29:32.635237 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:32.635236 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2r4s\" (UniqueName: \"kubernetes.io/projected/7415f72c-72fd-47e3-9001-be657fe2d28b-kube-api-access-r2r4s\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:29:33.163135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.163096 2562 generic.go:356] "Generic (PLEG): container finished" podID="7415f72c-72fd-47e3-9001-be657fe2d28b" containerID="5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b" exitCode=0 Jun 15 03:29:33.163325 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.163140 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b9d9c958f-bt468" Jun 15 03:29:33.163325 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.163184 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9d9c958f-bt468" event={"ID":"7415f72c-72fd-47e3-9001-be657fe2d28b","Type":"ContainerDied","Data":"5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b"} Jun 15 03:29:33.163325 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.163239 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b9d9c958f-bt468" event={"ID":"7415f72c-72fd-47e3-9001-be657fe2d28b","Type":"ContainerDied","Data":"5ad4ad5a89bc9407837614fefbf70cca2bbf37662c0330760667b7e07c4d93f3"} Jun 15 03:29:33.163325 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.163263 2562 scope.go:117] "RemoveContainer" containerID="5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b" Jun 15 03:29:33.171863 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.171849 2562 scope.go:117] "RemoveContainer" containerID="5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b" Jun 15 03:29:33.172144 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:29:33.172125 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b\": container with ID starting with 5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b not found: ID does not exist" containerID="5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b" Jun 15 03:29:33.172217 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.172151 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b"} err="failed to get container status \"5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b\": rpc error: code = NotFound desc = could not find container \"5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b\": container with ID starting with 5715910028a97b09dc819081774b1a24c82855c6bfb447118fb7ea118a68803b not found: ID does not exist" Jun 15 03:29:33.193745 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.193721 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b9d9c958f-bt468"] Jun 15 03:29:33.208175 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:33.208153 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b9d9c958f-bt468"] Jun 15 03:29:34.017167 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:34.017138 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7415f72c-72fd-47e3-9001-be657fe2d28b" path="/var/lib/kubelet/pods/7415f72c-72fd-47e3-9001-be657fe2d28b/volumes" Jun 15 03:29:57.878717 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:29:57.878672 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:30:05.616884 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:30:05.616844 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:30:22.885247 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:30:22.885208 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:30:29.579864 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:30:29.579831 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:30:35.188057 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:30:35.188020 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:30:43.475368 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:30:43.475330 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:31:36.693295 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.693258 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-685d74f464-gxgb6"] Jun 15 03:31:36.693679 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.693564 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7415f72c-72fd-47e3-9001-be657fe2d28b" containerName="authorino" Jun 15 03:31:36.693679 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.693575 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7415f72c-72fd-47e3-9001-be657fe2d28b" containerName="authorino" Jun 15 03:31:36.693679 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.693636 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7415f72c-72fd-47e3-9001-be657fe2d28b" containerName="authorino" Jun 15 03:31:36.696413 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.696398 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.703592 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.703557 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685d74f464-gxgb6"] Jun 15 03:31:36.750901 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.750873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcqpf\" (UniqueName: \"kubernetes.io/projected/2e8201ab-2d0d-418a-9dbf-916d5f005222-kube-api-access-hcqpf\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.751062 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.750912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2e8201ab-2d0d-418a-9dbf-916d5f005222-oidc-ca\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.751062 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.750958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2e8201ab-2d0d-418a-9dbf-916d5f005222-tls-cert\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.851992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.851956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcqpf\" (UniqueName: \"kubernetes.io/projected/2e8201ab-2d0d-418a-9dbf-916d5f005222-kube-api-access-hcqpf\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.852169 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.852005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2e8201ab-2d0d-418a-9dbf-916d5f005222-oidc-ca\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.852169 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.852044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2e8201ab-2d0d-418a-9dbf-916d5f005222-tls-cert\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.852622 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.852598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/2e8201ab-2d0d-418a-9dbf-916d5f005222-oidc-ca\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.854441 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.854411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2e8201ab-2d0d-418a-9dbf-916d5f005222-tls-cert\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:36.858556 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:36.858530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcqpf\" (UniqueName: \"kubernetes.io/projected/2e8201ab-2d0d-418a-9dbf-916d5f005222-kube-api-access-hcqpf\") pod \"authorino-685d74f464-gxgb6\" (UID: \"2e8201ab-2d0d-418a-9dbf-916d5f005222\") " pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:37.006200 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.006111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-685d74f464-gxgb6" Jun 15 03:31:37.139111 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.138989 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-685d74f464-gxgb6"] Jun 15 03:31:37.142073 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:31:37.142040 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e8201ab_2d0d_418a_9dbf_916d5f005222.slice/crio-459d1373e3a5da0185accb6a52f7d5122023bbc84d5308ccb046a05654ce6229 WatchSource:0}: Error finding container 459d1373e3a5da0185accb6a52f7d5122023bbc84d5308ccb046a05654ce6229: Status 404 returned error can't find the container with id 459d1373e3a5da0185accb6a52f7d5122023bbc84d5308ccb046a05654ce6229 Jun 15 03:31:37.720619 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.720584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685d74f464-gxgb6" event={"ID":"2e8201ab-2d0d-418a-9dbf-916d5f005222","Type":"ContainerStarted","Data":"a76ea94ed89935bd834bb289314797247f2ccde5a605b4909b095679a723667f"} Jun 15 03:31:37.720619 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.720621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-685d74f464-gxgb6" event={"ID":"2e8201ab-2d0d-418a-9dbf-916d5f005222","Type":"ContainerStarted","Data":"459d1373e3a5da0185accb6a52f7d5122023bbc84d5308ccb046a05654ce6229"} Jun 15 03:31:37.736436 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.736391 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-685d74f464-gxgb6" podStartSLOduration=1.3152177950000001 podStartE2EDuration="1.73637297s" totalImagesPullingTime="421.155175ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:31:37.734615757 +0000 UTC m=+824.209551211" watchObservedRunningTime="2026-06-15 03:31:37.73637297 +0000 UTC m=+824.211308424" Jun 15 03:31:37.763385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.763350 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-578bd54477-tz4hd"] Jun 15 03:31:37.763602 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:37.763575 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-578bd54477-tz4hd" podUID="bded5bb1-0415-4b71-a894-c159da75d953" containerName="authorino" containerID="cri-o://16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018" gracePeriod=30 Jun 15 03:31:38.022582 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.022558 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:31:38.065465 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.064802 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhmd4\" (UniqueName: \"kubernetes.io/projected/bded5bb1-0415-4b71-a894-c159da75d953-kube-api-access-vhmd4\") pod \"bded5bb1-0415-4b71-a894-c159da75d953\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " Jun 15 03:31:38.065465 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.064866 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bded5bb1-0415-4b71-a894-c159da75d953-tls-cert\") pod \"bded5bb1-0415-4b71-a894-c159da75d953\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " Jun 15 03:31:38.065465 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.064923 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bded5bb1-0415-4b71-a894-c159da75d953-oidc-ca\") pod \"bded5bb1-0415-4b71-a894-c159da75d953\" (UID: \"bded5bb1-0415-4b71-a894-c159da75d953\") " Jun 15 03:31:38.068022 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.067980 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bded5bb1-0415-4b71-a894-c159da75d953-kube-api-access-vhmd4" (OuterVolumeSpecName: "kube-api-access-vhmd4") pod "bded5bb1-0415-4b71-a894-c159da75d953" (UID: "bded5bb1-0415-4b71-a894-c159da75d953"). InnerVolumeSpecName "kube-api-access-vhmd4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:31:38.072229 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.072190 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bded5bb1-0415-4b71-a894-c159da75d953-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "bded5bb1-0415-4b71-a894-c159da75d953" (UID: "bded5bb1-0415-4b71-a894-c159da75d953"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:31:38.075875 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.075842 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bded5bb1-0415-4b71-a894-c159da75d953-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bded5bb1-0415-4b71-a894-c159da75d953" (UID: "bded5bb1-0415-4b71-a894-c159da75d953"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 03:31:38.165772 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.165684 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhmd4\" (UniqueName: \"kubernetes.io/projected/bded5bb1-0415-4b71-a894-c159da75d953-kube-api-access-vhmd4\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:31:38.165772 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.165723 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bded5bb1-0415-4b71-a894-c159da75d953-tls-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:31:38.165772 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.165763 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/bded5bb1-0415-4b71-a894-c159da75d953-oidc-ca\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:31:38.726898 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.726859 2562 generic.go:356] "Generic (PLEG): container finished" podID="bded5bb1-0415-4b71-a894-c159da75d953" containerID="16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018" exitCode=0 Jun 15 03:31:38.727394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.726919 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-578bd54477-tz4hd" Jun 15 03:31:38.727394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.726973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-578bd54477-tz4hd" event={"ID":"bded5bb1-0415-4b71-a894-c159da75d953","Type":"ContainerDied","Data":"16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018"} Jun 15 03:31:38.727394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.727016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-578bd54477-tz4hd" event={"ID":"bded5bb1-0415-4b71-a894-c159da75d953","Type":"ContainerDied","Data":"590d416c72aa4d035ceaa718daeea2f9ea22eebb3e5bdce58f9104bea4ea8c5d"} Jun 15 03:31:38.727394 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.727030 2562 scope.go:117] "RemoveContainer" containerID="16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018" Jun 15 03:31:38.736026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.736007 2562 scope.go:117] "RemoveContainer" containerID="16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018" Jun 15 03:31:38.736298 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:31:38.736267 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018\": container with ID starting with 16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018 not found: ID does not exist" containerID="16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018" Jun 15 03:31:38.736388 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.736294 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018"} err="failed to get container status \"16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018\": rpc error: code = NotFound desc = could not find container \"16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018\": container with ID starting with 16c1953c18f1780bb432fd6b80d547b8cfc550ac357dbf1bcbf5c12edebc2018 not found: ID does not exist" Jun 15 03:31:38.748288 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.748264 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-578bd54477-tz4hd"] Jun 15 03:31:38.751087 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:38.751068 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-578bd54477-tz4hd"] Jun 15 03:31:40.017643 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:31:40.017598 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bded5bb1-0415-4b71-a894-c159da75d953" path="/var/lib/kubelet/pods/bded5bb1-0415-4b71-a894-c159da75d953/volumes" Jun 15 03:32:00.270325 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:00.270292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:04.478473 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:04.478433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:11.481070 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:11.481034 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:21.375417 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:21.375380 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:30.683652 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:30.683604 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:41.473063 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:41.473026 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:50.184584 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:50.184507 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:32:54.004070 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:54.004038 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:32:54.004955 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:54.004914 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:32:59.980866 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:32:59.980833 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:33:33.178135 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:33:33.178097 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:33:37.875766 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:33:37.875730 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:34:13.785463 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:34:13.785375 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:34:29.970635 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:34:29.970593 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:35:08.188154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:35:08.188113 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:35:24.878014 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:35:24.877983 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:35:39.189568 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:35:39.189533 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:35:55.171611 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:35:55.171533 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:36:54.780099 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:36:54.780061 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:37:03.679820 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:03.679787 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:37:20.578245 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:20.578155 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:37:29.271890 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:29.271852 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:37:46.782106 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:46.782069 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:37:54.031771 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:54.031745 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:37:54.033195 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:54.033174 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:37:55.273507 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:37:55.273473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:38:27.495564 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:38:27.495527 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:38:36.271017 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:38:36.270985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:38:45.270670 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:38:45.270463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:38:52.580173 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:38:52.580134 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:39:01.081623 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:39:01.081583 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:39:09.871466 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:39:09.871426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:39:13.783294 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:39:13.783260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:39:26.673784 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:39:26.673748 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:39:38.171352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:39:38.171320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:40:25.376810 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:40:25.376775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:40:33.277448 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:40:33.277410 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:40:52.375762 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:40:52.375728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:00.881468 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:00.881433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:09.678154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:09.678122 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:18.469821 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:18.469786 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:27.387643 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:27.387608 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:36.071557 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:36.071521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:44.980170 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:44.980086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:41:53.680417 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:41:53.680384 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:42:01.674027 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:42:01.673995 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:42:09.981268 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:42:09.981234 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:42:54.057573 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:42:54.057545 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:42:54.060324 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:42:54.060298 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:44:31.887663 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:44:31.887610 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:44:36.177408 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:44:36.177374 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:00.136510 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.136428 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691585-7r4fg"] Jun 15 03:45:00.136877 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.136786 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bded5bb1-0415-4b71-a894-c159da75d953" containerName="authorino" Jun 15 03:45:00.136877 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.136801 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bded5bb1-0415-4b71-a894-c159da75d953" containerName="authorino" Jun 15 03:45:00.136877 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.136870 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bded5bb1-0415-4b71-a894-c159da75d953" containerName="authorino" Jun 15 03:45:00.139719 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.139703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:00.141873 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.141854 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7nftz\"" Jun 15 03:45:00.143996 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.143969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzddh\" (UniqueName: \"kubernetes.io/projected/00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28-kube-api-access-wzddh\") pod \"maas-api-key-cleanup-29691585-7r4fg\" (UID: \"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28\") " pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:00.145745 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.145724 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691585-7r4fg"] Jun 15 03:45:00.245364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.245332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzddh\" (UniqueName: \"kubernetes.io/projected/00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28-kube-api-access-wzddh\") pod \"maas-api-key-cleanup-29691585-7r4fg\" (UID: \"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28\") " pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:00.253466 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.253440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzddh\" (UniqueName: \"kubernetes.io/projected/00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28-kube-api-access-wzddh\") pod \"maas-api-key-cleanup-29691585-7r4fg\" (UID: \"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28\") " pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:00.451643 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.451559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:00.581069 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.581040 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691585-7r4fg"] Jun 15 03:45:00.584299 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:45:00.584275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00c7af52_1bb6_41c4_ab23_0e7d5e1a5c28.slice/crio-71b63d84a5cd2e6a936d2a1ce961ff7191814487716d0fb98820bb207f4777dd WatchSource:0}: Error finding container 71b63d84a5cd2e6a936d2a1ce961ff7191814487716d0fb98820bb207f4777dd: Status 404 returned error can't find the container with id 71b63d84a5cd2e6a936d2a1ce961ff7191814487716d0fb98820bb207f4777dd Jun 15 03:45:00.586292 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:00.586276 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:45:01.197604 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:01.197570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" event={"ID":"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28","Type":"ContainerStarted","Data":"71b63d84a5cd2e6a936d2a1ce961ff7191814487716d0fb98820bb207f4777dd"} Jun 15 03:45:01.781050 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:01.781011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:04.214110 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:04.214020 2562 generic.go:356] "Generic (PLEG): container finished" podID="00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28" containerID="3eba2c0a32110cf3e5f78faf0ef9568850e11672edfff3b9356d837f1259bf02" exitCode=0 Jun 15 03:45:04.214110 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:04.214079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" event={"ID":"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28","Type":"ContainerDied","Data":"3eba2c0a32110cf3e5f78faf0ef9568850e11672edfff3b9356d837f1259bf02"} Jun 15 03:45:05.343803 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:05.343780 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:05.388630 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:05.388594 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzddh\" (UniqueName: \"kubernetes.io/projected/00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28-kube-api-access-wzddh\") pod \"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28\" (UID: \"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28\") " Jun 15 03:45:05.390819 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:05.390785 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28-kube-api-access-wzddh" (OuterVolumeSpecName: "kube-api-access-wzddh") pod "00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28" (UID: "00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28"). InnerVolumeSpecName "kube-api-access-wzddh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:45:05.489807 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:05.489725 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzddh\" (UniqueName: \"kubernetes.io/projected/00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28-kube-api-access-wzddh\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:45:06.082792 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:06.082758 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:06.225148 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:06.225112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" event={"ID":"00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28","Type":"ContainerDied","Data":"71b63d84a5cd2e6a936d2a1ce961ff7191814487716d0fb98820bb207f4777dd"} Jun 15 03:45:06.225302 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:06.225162 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="71b63d84a5cd2e6a936d2a1ce961ff7191814487716d0fb98820bb207f4777dd" Jun 15 03:45:06.225302 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:06.225167 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691585-7r4fg" Jun 15 03:45:13.680469 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:13.680437 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:23.469617 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:23.469583 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:32.779820 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:32.779784 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:43.179965 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:43.179911 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:45:52.278269 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:45:52.278238 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:46:02.978150 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:46:02.978111 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:46:11.484869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:46:11.484828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:46:21.771031 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:46:21.770943 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:46:31.174900 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:46:31.174870 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:46:35.974329 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:46:35.974294 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:47:04.180391 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:47:04.180357 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:47:47.183748 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:47:47.183653 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:47:54.083392 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:47:54.083361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:47:54.087103 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:47:54.087080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:47:55.372057 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:47:55.372024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:04.376207 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:04.376171 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:12.775505 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:12.775465 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:21.678910 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:21.678874 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:34.175829 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:34.175791 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:43.082081 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:43.082048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:48.575261 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:48.575227 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:48:55.476073 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:48:55.476036 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:49:03.091923 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:49:03.091888 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:49:11.973988 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:49:11.973954 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:49:22.280094 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:49:22.280011 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:49:40.281655 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:49:40.281619 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:49:48.089103 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:49:48.089068 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:49:57.578838 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:49:57.578793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:50:05.870702 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:50:05.870671 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:50:22.982725 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:50:22.982683 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:50:31.078210 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:50:31.078178 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:50:40.276708 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:50:40.276673 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:50:48.878367 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:50:48.878286 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:50:57.479461 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:50:57.479427 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:51:06.271539 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:51:06.271502 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:51:14.976350 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:51:14.976311 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:51:25.881291 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:51:25.881258 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:51:35.079205 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:51:35.079167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:51:45.984621 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:51:45.984584 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:51:55.280605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:51:55.280572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:00.782727 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:00.782691 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:07.987097 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:07.987058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:13.073549 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:13.073513 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:27.472333 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:27.472297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:36.181011 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:36.180975 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:45.580753 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:45.580720 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:51.880423 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:51.880391 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:52:54.109888 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:54.109857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:52:54.114321 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:52:54.114298 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:53:15.378054 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:15.378016 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:53:27.779853 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:27.779820 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-tl9mr"] Jun 15 03:53:28.500074 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.500036 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd"] Jun 15 03:53:28.500566 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.500545 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28" containerName="cleanup" Jun 15 03:53:28.500635 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.500570 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28" containerName="cleanup" Jun 15 03:53:28.500691 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.500682 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28" containerName="cleanup" Jun 15 03:53:28.504127 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.504101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.506323 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.506299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ef39ff1f-openshift-default-dockercfg-rsnvk\"" Jun 15 03:53:28.506709 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.506690 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 03:53:28.521551 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.521530 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd"] Jun 15 03:53:28.540927 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.540894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-certs\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541073 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.540959 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-socket\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541073 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.540991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-data\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541073 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.541016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-token\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541073 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.541042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-credential-socket\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.541149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-podinfo\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.541187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833d1cbc-1263-4ecf-8e16-8fedc471463f-istiod-ca-cert\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541331 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.541245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-envoy\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.541331 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.541291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksnnx\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-kube-api-access-ksnnx\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642019 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.641983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-podinfo\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833d1cbc-1263-4ecf-8e16-8fedc471463f-istiod-ca-cert\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642075 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-envoy\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksnnx\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-kube-api-access-ksnnx\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-certs\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-socket\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642228 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-data\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642543 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-token\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642543 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642282 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-credential-socket\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642910 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-data\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642910 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-socket\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.642910 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.642846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-credential-socket\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.643182 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.643141 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-certs\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.643445 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.643415 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833d1cbc-1263-4ecf-8e16-8fedc471463f-istiod-ca-cert\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.645034 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.644963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-envoy\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.645298 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.645274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-podinfo\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.650903 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.650884 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksnnx\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-kube-api-access-ksnnx\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.654577 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.654532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-token\") pod \"e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.817326 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.817229 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:28.961300 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.961124 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd"] Jun 15 03:53:28.964342 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:53:28.964304 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833d1cbc_1263_4ecf_8e16_8fedc471463f.slice/crio-e00914cfee7a55a40c6c2f41334b376e309782a7da5be720710bb33ea5362147 WatchSource:0}: Error finding container e00914cfee7a55a40c6c2f41334b376e309782a7da5be720710bb33ea5362147: Status 404 returned error can't find the container with id e00914cfee7a55a40c6c2f41334b376e309782a7da5be720710bb33ea5362147 Jun 15 03:53:28.966594 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:28.966577 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 03:53:29.436514 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:29.436479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" event={"ID":"833d1cbc-1263-4ecf-8e16-8fedc471463f","Type":"ContainerStarted","Data":"e00914cfee7a55a40c6c2f41334b376e309782a7da5be720710bb33ea5362147"} Jun 15 03:53:31.585761 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:31.585718 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 03:53:31.586066 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:31.585797 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 03:53:31.586066 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:31.585826 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 03:53:32.454332 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:32.454296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" event={"ID":"833d1cbc-1263-4ecf-8e16-8fedc471463f","Type":"ContainerStarted","Data":"ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344"} Jun 15 03:53:32.472373 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:32.472313 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" podStartSLOduration=1.853559948 podStartE2EDuration="4.472296439s" totalImagesPullingTime="2.618736491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:53:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:53:32.47141447 +0000 UTC m=+2138.946349924" watchObservedRunningTime="2026-06-15 03:53:32.472296439 +0000 UTC m=+2138.947231893" Jun 15 03:53:32.817504 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:32.817414 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:32.822201 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:32.822179 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:33.458542 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:33.458507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:33.459406 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:33.459385 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:34.911971 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:34.911921 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd"] Jun 15 03:53:35.467690 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:35.467661 2562 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" secret="" err="secret \"e2e-ait-ef39ff1f-openshift-default-dockercfg-rsnvk\" not found" Jun 15 03:53:36.471575 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:36.471480 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" podUID="833d1cbc-1263-4ecf-8e16-8fedc471463f" containerName="istio-proxy" containerID="cri-o://ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344" gracePeriod=30 Jun 15 03:53:40.858344 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.858310 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q"] Jun 15 03:53:40.862158 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.862131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.865345 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.865322 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e3153e0a-openshift-default-dockercfg-p4sqr\"" Jun 15 03:53:40.875869 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.875843 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q"] Jun 15 03:53:40.946924 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.946891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8fxv\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-kube-api-access-k8fxv\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.946924 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.946928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0495f97-5564-495b-a961-08d84957eb39-istiod-ca-cert\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947174 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-envoy\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947174 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-istio-token\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947174 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-socket\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947174 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-credential-socket\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947373 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947191 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-data\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947373 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-certs\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:40.947373 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:40.947284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0495f97-5564-495b-a961-08d84957eb39-istio-podinfo\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048233 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-data\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048407 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048266 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-certs\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048407 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0495f97-5564-495b-a961-08d84957eb39-istio-podinfo\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048407 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8fxv\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-kube-api-access-k8fxv\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048571 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0495f97-5564-495b-a961-08d84957eb39-istiod-ca-cert\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048623 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-envoy\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048623 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-istio-token\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048740 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-certs\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048740 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-socket\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048740 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-data\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.048740 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-credential-socket\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.049010 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.048977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-socket\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.049095 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.049028 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-credential-socket\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.049248 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.049229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0495f97-5564-495b-a961-08d84957eb39-istiod-ca-cert\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.050788 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.050754 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-envoy\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.050911 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.050893 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0495f97-5564-495b-a961-08d84957eb39-istio-podinfo\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.056746 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.056716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8fxv\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-kube-api-access-k8fxv\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.057140 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.057119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-istio-token\") pod \"e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.174122 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.174046 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:41.306556 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.306523 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q"] Jun 15 03:53:41.309652 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:53:41.309624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0495f97_5564_495b_a961_08d84957eb39.slice/crio-3c6bcba0223372bd3adcb7360655253a5745bcf420a3dc33a5a2e349b220afc4 WatchSource:0}: Error finding container 3c6bcba0223372bd3adcb7360655253a5745bcf420a3dc33a5a2e349b220afc4: Status 404 returned error can't find the container with id 3c6bcba0223372bd3adcb7360655253a5745bcf420a3dc33a5a2e349b220afc4 Jun 15 03:53:41.312742 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.312711 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 03:53:41.312799 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.312781 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 03:53:41.312841 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.312810 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 15 03:53:41.495353 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.495319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" event={"ID":"c0495f97-5564-495b-a961-08d84957eb39","Type":"ContainerStarted","Data":"19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff"} Jun 15 03:53:41.495471 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.495388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" event={"ID":"c0495f97-5564-495b-a961-08d84957eb39","Type":"ContainerStarted","Data":"3c6bcba0223372bd3adcb7360655253a5745bcf420a3dc33a5a2e349b220afc4"} Jun 15 03:53:41.515442 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.515391 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" podStartSLOduration=1.515375753 podStartE2EDuration="1.515375753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:53:41.513817894 +0000 UTC m=+2147.988753381" watchObservedRunningTime="2026-06-15 03:53:41.515375753 +0000 UTC m=+2147.990311281" Jun 15 03:53:41.707341 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.707319 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:41.756047 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.755977 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-certs\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756047 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksnnx\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-kube-api-access-ksnnx\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756108 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-socket\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756145 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-token\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756168 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-envoy\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756216 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833d1cbc-1263-4ecf-8e16-8fedc471463f-istiod-ca-cert\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756228 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:41.756352 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756248 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-credential-socket\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756675 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756464 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-data\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756675 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756476 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:41.756675 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756499 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-podinfo\") pod \"833d1cbc-1263-4ecf-8e16-8fedc471463f\" (UID: \"833d1cbc-1263-4ecf-8e16-8fedc471463f\") " Jun 15 03:53:41.756675 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756507 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/833d1cbc-1263-4ecf-8e16-8fedc471463f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:53:41.756675 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756660 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-data" (OuterVolumeSpecName: "istio-data") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:41.756959 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756714 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:41.756959 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756834 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/833d1cbc-1263-4ecf-8e16-8fedc471463f-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.756959 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756852 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.756959 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756868 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.756959 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756881 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.756959 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.756894 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.758436 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.758408 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-kube-api-access-ksnnx" (OuterVolumeSpecName: "kube-api-access-ksnnx") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "kube-api-access-ksnnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:53:41.758550 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.758473 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-token" (OuterVolumeSpecName: "istio-token") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:53:41.758691 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.758655 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:41.758791 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.758771 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "833d1cbc-1263-4ecf-8e16-8fedc471463f" (UID: "833d1cbc-1263-4ecf-8e16-8fedc471463f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 03:53:41.858271 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.858248 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.858271 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.858268 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.858271 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.858276 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/833d1cbc-1263-4ecf-8e16-8fedc471463f-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:41.858653 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:41.858284 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksnnx\" (UniqueName: \"kubernetes.io/projected/833d1cbc-1263-4ecf-8e16-8fedc471463f-kube-api-access-ksnnx\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:42.174787 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.174743 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:42.179157 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.179135 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:42.501537 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.501504 2562 generic.go:356] "Generic (PLEG): container finished" podID="833d1cbc-1263-4ecf-8e16-8fedc471463f" containerID="ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344" exitCode=0 Jun 15 03:53:42.501734 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.501565 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" Jun 15 03:53:42.501734 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.501600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" event={"ID":"833d1cbc-1263-4ecf-8e16-8fedc471463f","Type":"ContainerDied","Data":"ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344"} Jun 15 03:53:42.501734 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.501663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd" event={"ID":"833d1cbc-1263-4ecf-8e16-8fedc471463f","Type":"ContainerDied","Data":"e00914cfee7a55a40c6c2f41334b376e309782a7da5be720710bb33ea5362147"} Jun 15 03:53:42.501734 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.501693 2562 scope.go:117] "RemoveContainer" containerID="ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344" Jun 15 03:53:42.501992 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.501972 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:42.503201 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.503029 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:42.510561 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.510537 2562 scope.go:117] "RemoveContainer" containerID="ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344" Jun 15 03:53:42.510866 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:53:42.510839 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344\": container with ID starting with ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344 not found: ID does not exist" containerID="ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344" Jun 15 03:53:42.510948 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.510874 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344"} err="failed to get container status \"ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344\": rpc error: code = NotFound desc = could not find container \"ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344\": container with ID starting with ce7a20e7027bbdc17ed1aa9c6092c751b5c75734a04782af33c979e63ece4344 not found: ID does not exist" Jun 15 03:53:42.517388 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.517367 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd"] Jun 15 03:53:42.520697 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:42.520676 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ef39ff1f-openshift-default-6585b5c866-kzkdd"] Jun 15 03:53:44.018358 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:44.018329 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="833d1cbc-1263-4ecf-8e16-8fedc471463f" path="/var/lib/kubelet/pods/833d1cbc-1263-4ecf-8e16-8fedc471463f/volumes" Jun 15 03:53:48.278560 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:48.278526 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q"] Jun 15 03:53:48.279121 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:48.278706 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" podUID="c0495f97-5564-495b-a961-08d84957eb39" containerName="istio-proxy" containerID="cri-o://19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff" gracePeriod=30 Jun 15 03:53:53.536704 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.536679 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:53.551962 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.551876 2562 generic.go:356] "Generic (PLEG): container finished" podID="c0495f97-5564-495b-a961-08d84957eb39" containerID="19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff" exitCode=0 Jun 15 03:53:53.551962 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.551947 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" Jun 15 03:53:53.552154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.551966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" event={"ID":"c0495f97-5564-495b-a961-08d84957eb39","Type":"ContainerDied","Data":"19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff"} Jun 15 03:53:53.552154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.552062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q" event={"ID":"c0495f97-5564-495b-a961-08d84957eb39","Type":"ContainerDied","Data":"3c6bcba0223372bd3adcb7360655253a5745bcf420a3dc33a5a2e349b220afc4"} Jun 15 03:53:53.552154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.552094 2562 scope.go:117] "RemoveContainer" containerID="19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff" Jun 15 03:53:53.561236 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.561217 2562 scope.go:117] "RemoveContainer" containerID="19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff" Jun 15 03:53:53.561520 ip-10-0-128-105 kubenswrapper[2562]: E0615 03:53:53.561502 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff\": container with ID starting with 19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff not found: ID does not exist" containerID="19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff" Jun 15 03:53:53.561604 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.561527 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff"} err="failed to get container status \"19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff\": rpc error: code = NotFound desc = could not find container \"19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff\": container with ID starting with 19230ca93dafab58df9cb351661b39320ed74461c0cd8f3a50100454e97465ff not found: ID does not exist" Jun 15 03:53:53.661903 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.661874 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-istio-token\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662072 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.661921 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-socket\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662072 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.661956 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0495f97-5564-495b-a961-08d84957eb39-istio-podinfo\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662072 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.661985 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0495f97-5564-495b-a961-08d84957eb39-istiod-ca-cert\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662072 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662020 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-data\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662072 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662048 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-certs\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662342 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662091 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8fxv\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-kube-api-access-k8fxv\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662342 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662117 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-credential-socket\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662342 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662152 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-envoy\") pod \"c0495f97-5564-495b-a961-08d84957eb39\" (UID: \"c0495f97-5564-495b-a961-08d84957eb39\") " Jun 15 03:53:53.662342 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662189 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:53.662544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662385 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-data" (OuterVolumeSpecName: "istio-data") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:53.662544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662449 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:53.662544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662480 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0495f97-5564-495b-a961-08d84957eb39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 03:53:53.662544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662510 2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.662544 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662528 2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-data\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.662806 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.662675 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:53.664323 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.664293 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-kube-api-access-k8fxv" (OuterVolumeSpecName: "kube-api-access-k8fxv") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "kube-api-access-k8fxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:53:53.664440 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.664332 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 03:53:53.664601 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.664564 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c0495f97-5564-495b-a961-08d84957eb39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 15 03:53:53.664661 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.664643 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-istio-token" (OuterVolumeSpecName: "istio-token") pod "c0495f97-5564-495b-a961-08d84957eb39" (UID: "c0495f97-5564-495b-a961-08d84957eb39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 03:53:53.763188 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763151 2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-workload-certs\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.763188 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763185 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8fxv\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-kube-api-access-k8fxv\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.763188 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763196 2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-credential-socket\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.763380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763205 2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c0495f97-5564-495b-a961-08d84957eb39-istio-envoy\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.763380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763213 2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c0495f97-5564-495b-a961-08d84957eb39-istio-token\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.763380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763220 2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c0495f97-5564-495b-a961-08d84957eb39-istio-podinfo\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.763380 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.763227 2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c0495f97-5564-495b-a961-08d84957eb39-istiod-ca-cert\") on node \"ip-10-0-128-105.ec2.internal\" DevicePath \"\"" Jun 15 03:53:53.872957 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.872919 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q"] Jun 15 03:53:53.876562 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:53.876540 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e3153e0a-openshift-default-5cf8fd85fb-sqv9q"] Jun 15 03:53:54.016446 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:53:54.016415 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0495f97-5564-495b-a961-08d84957eb39" path="/var/lib/kubelet/pods/c0495f97-5564-495b-a961-08d84957eb39/volumes" Jun 15 03:54:00.391606 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:00.391577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685d74f464-gxgb6_2e8201ab-2d0d-418a-9dbf-916d5f005222/authorino/0.log" Jun 15 03:54:05.609238 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:05.609211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691585-7r4fg_00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28/cleanup/0.log" Jun 15 03:54:06.192911 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:06.192886 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-k245g_06566df1-73a8-4a3d-a717-d75b67e3a232/copy-manifests/0.log" Jun 15 03:54:06.199961 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:06.199918 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-k245g_06566df1-73a8-4a3d-a717-d75b67e3a232/manager/0.log" Jun 15 03:54:07.682390 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:07.682360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685d74f464-gxgb6_2e8201ab-2d0d-418a-9dbf-916d5f005222/authorino/0.log" Jun 15 03:54:08.036796 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:08.036720 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8v2z_82e817fe-ca59-49bd-a833-d3e8c59e3e75/kuadrant-console-plugin/0.log" Jun 15 03:54:08.392806 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:08.392780 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tl9mr_48a50196-c99b-4571-9bb5-b178e9eb01d5/limitador/0.log" Jun 15 03:54:09.073859 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:09.073833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79fc99d74-gzktx_fa7911c0-6dc5-4056-9d17-3e46bf4ced3c/kube-auth-proxy/0.log" Jun 15 03:54:09.646007 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:09.645977 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bd986dc6-w8m6k_b4ff6f0d-4802-479f-a1d5-f5f6f42e0405/router/0.log" Jun 15 03:54:14.414587 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414552 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hnz2l/must-gather-frqrg"] Jun 15 03:54:14.415009 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414882 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0495f97-5564-495b-a961-08d84957eb39" containerName="istio-proxy" Jun 15 03:54:14.415009 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414893 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0495f97-5564-495b-a961-08d84957eb39" containerName="istio-proxy" Jun 15 03:54:14.415009 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414903 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="833d1cbc-1263-4ecf-8e16-8fedc471463f" containerName="istio-proxy" Jun 15 03:54:14.415009 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414908 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="833d1cbc-1263-4ecf-8e16-8fedc471463f" containerName="istio-proxy" Jun 15 03:54:14.415009 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414982 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="833d1cbc-1263-4ecf-8e16-8fedc471463f" containerName="istio-proxy" Jun 15 03:54:14.415009 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.414989 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0495f97-5564-495b-a961-08d84957eb39" containerName="istio-proxy" Jun 15 03:54:14.418154 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.418137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.420605 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.420575 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hnz2l\"/\"kube-root-ca.crt\"" Jun 15 03:54:14.420709 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.420612 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hnz2l\"/\"default-dockercfg-prgpg\"" Jun 15 03:54:14.421278 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.421260 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hnz2l\"/\"openshift-service-ca.crt\"" Jun 15 03:54:14.428971 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.428920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnz2l/must-gather-frqrg"] Jun 15 03:54:14.533331 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.533291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/99da1a4e-bd3f-446f-97a4-093b451bba04-must-gather-output\") pod \"must-gather-frqrg\" (UID: \"99da1a4e-bd3f-446f-97a4-093b451bba04\") " pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.533508 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.533361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6jf4\" (UniqueName: \"kubernetes.io/projected/99da1a4e-bd3f-446f-97a4-093b451bba04-kube-api-access-k6jf4\") pod \"must-gather-frqrg\" (UID: \"99da1a4e-bd3f-446f-97a4-093b451bba04\") " pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.634322 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.634281 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/99da1a4e-bd3f-446f-97a4-093b451bba04-must-gather-output\") pod \"must-gather-frqrg\" (UID: \"99da1a4e-bd3f-446f-97a4-093b451bba04\") " pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.634469 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.634365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6jf4\" (UniqueName: \"kubernetes.io/projected/99da1a4e-bd3f-446f-97a4-093b451bba04-kube-api-access-k6jf4\") pod \"must-gather-frqrg\" (UID: \"99da1a4e-bd3f-446f-97a4-093b451bba04\") " pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.634648 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.634628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/99da1a4e-bd3f-446f-97a4-093b451bba04-must-gather-output\") pod \"must-gather-frqrg\" (UID: \"99da1a4e-bd3f-446f-97a4-093b451bba04\") " pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.643281 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.643258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6jf4\" (UniqueName: \"kubernetes.io/projected/99da1a4e-bd3f-446f-97a4-093b451bba04-kube-api-access-k6jf4\") pod \"must-gather-frqrg\" (UID: \"99da1a4e-bd3f-446f-97a4-093b451bba04\") " pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.728364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.728283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnz2l/must-gather-frqrg" Jun 15 03:54:14.857044 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:14.857018 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnz2l/must-gather-frqrg"] Jun 15 03:54:14.859806 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:54:14.859779 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod99da1a4e_bd3f_446f_97a4_093b451bba04.slice/crio-da0756df3f0bdff772bcf2edad7cba021540cb308bffbe8a98e26be3be94697b WatchSource:0}: Error finding container da0756df3f0bdff772bcf2edad7cba021540cb308bffbe8a98e26be3be94697b: Status 404 returned error can't find the container with id da0756df3f0bdff772bcf2edad7cba021540cb308bffbe8a98e26be3be94697b Jun 15 03:54:15.650728 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:15.650694 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/must-gather-frqrg" event={"ID":"99da1a4e-bd3f-446f-97a4-093b451bba04","Type":"ContainerStarted","Data":"da0756df3f0bdff772bcf2edad7cba021540cb308bffbe8a98e26be3be94697b"} Jun 15 03:54:16.658118 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:16.658079 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/must-gather-frqrg" event={"ID":"99da1a4e-bd3f-446f-97a4-093b451bba04","Type":"ContainerStarted","Data":"3c25b9a3c0a2e51af895799d2d986d90227686b767727420fc620a709ca6eb2c"} Jun 15 03:54:16.658489 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:16.658130 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/must-gather-frqrg" event={"ID":"99da1a4e-bd3f-446f-97a4-093b451bba04","Type":"ContainerStarted","Data":"2ad2b43bbf404698ad87544719fbe42cdf779c25a78b9624db7149b484ecf648"} Jun 15 03:54:16.674305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:16.674248 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hnz2l/must-gather-frqrg" podStartSLOduration=1.897351375 podStartE2EDuration="2.674227199s" totalImagesPullingTime="776.875824ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 03:54:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:54:16.672057423 +0000 UTC m=+2183.146992877" watchObservedRunningTime="2026-06-15 03:54:16.674227199 +0000 UTC m=+2183.149162655" Jun 15 03:54:17.345312 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:17.345286 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8bp2g_80a405e9-d122-4234-8d5b-7957e771d871/global-pull-secret-syncer/0.log" Jun 15 03:54:17.523447 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:17.523420 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ncb7d_a3c91368-d1e3-4e81-919c-74c21b07631d/konnectivity-agent/0.log" Jun 15 03:54:17.542697 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:17.542676 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-105.ec2.internal_ee2e1426c7d8d6fc3f7c93a631682417/haproxy/0.log" Jun 15 03:54:22.753435 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:22.753294 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-685d74f464-gxgb6_2e8201ab-2d0d-418a-9dbf-916d5f005222/authorino/0.log" Jun 15 03:54:22.859103 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:22.859067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-x8v2z_82e817fe-ca59-49bd-a833-d3e8c59e3e75/kuadrant-console-plugin/0.log" Jun 15 03:54:22.985250 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:22.985208 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-tl9mr_48a50196-c99b-4571-9bb5-b178e9eb01d5/limitador/0.log" Jun 15 03:54:24.732087 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:24.732046 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-kmgvd_476951b2-68d4-494b-b9f4-7151eb1287c0/cluster-monitoring-operator/0.log" Jun 15 03:54:24.834711 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:24.834680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5c489ff7c5-z4g2w_3ced8bcb-fec0-4430-99f3-0e1291989c3c/metrics-server/0.log" Jun 15 03:54:24.970444 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:24.970400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b5rsn_097568c6-35b1-4f02-b9be-2d747c252d73/node-exporter/0.log" Jun 15 03:54:24.991225 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:24.991130 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b5rsn_097568c6-35b1-4f02-b9be-2d747c252d73/kube-rbac-proxy/0.log" Jun 15 03:54:25.011413 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.011390 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b5rsn_097568c6-35b1-4f02-b9be-2d747c252d73/init-textfile/0.log" Jun 15 03:54:25.541944 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.541892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d64dd9df4-4n2wq_beb43489-9ab5-47c6-bef9-8a90712a6f0a/thanos-query/0.log" Jun 15 03:54:25.566880 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.566848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d64dd9df4-4n2wq_beb43489-9ab5-47c6-bef9-8a90712a6f0a/kube-rbac-proxy-web/0.log" Jun 15 03:54:25.606983 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.606953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d64dd9df4-4n2wq_beb43489-9ab5-47c6-bef9-8a90712a6f0a/kube-rbac-proxy/0.log" Jun 15 03:54:25.634819 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.634788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d64dd9df4-4n2wq_beb43489-9ab5-47c6-bef9-8a90712a6f0a/prom-label-proxy/0.log" Jun 15 03:54:25.666192 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.666061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d64dd9df4-4n2wq_beb43489-9ab5-47c6-bef9-8a90712a6f0a/kube-rbac-proxy-rules/0.log" Jun 15 03:54:25.693606 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:25.693582 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d64dd9df4-4n2wq_beb43489-9ab5-47c6-bef9-8a90712a6f0a/kube-rbac-proxy-metrics/0.log" Jun 15 03:54:27.048408 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:27.048377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-jv7nv_a55324fd-0b52-4171-a3cf-e3bd800c8b27/networking-console-plugin/0.log" Jun 15 03:54:27.749987 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:27.749958 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/1.log" Jun 15 03:54:27.757477 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:27.757452 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-b55b8_6a660f48-a8f1-4920-8aa3-003554456b23/console-operator/2.log" Jun 15 03:54:29.052592 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.052547 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-4sffg_0ad23080-f47a-4591-b985-6d8af588b9d7/volume-data-source-validator/0.log" Jun 15 03:54:29.210795 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.210748 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g"] Jun 15 03:54:29.219900 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.219875 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.223465 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.223439 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g"] Jun 15 03:54:29.294977 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.294923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6j88\" (UniqueName: \"kubernetes.io/projected/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-kube-api-access-t6j88\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.295178 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.295039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-proc\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.295178 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.295150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-sys\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.295305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.295181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-podres\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.295305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.295238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-lib-modules\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396186 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-sys\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396186 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-podres\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396454 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-lib-modules\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396454 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-sys\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396454 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6j88\" (UniqueName: \"kubernetes.io/projected/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-kube-api-access-t6j88\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396454 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-proc\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396454 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-podres\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396454 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-lib-modules\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.396811 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.396467 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-proc\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.404449 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.404404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6j88\" (UniqueName: \"kubernetes.io/projected/6dd299c4-05a1-4f21-ac5b-081c6f10a7f7-kube-api-access-t6j88\") pod \"perf-node-gather-daemonset-rww5g\" (UID: \"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7\") " pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.533677 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.533641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:29.715500 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.715462 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g"] Jun 15 03:54:29.718630 ip-10-0-128-105 kubenswrapper[2562]: W0615 03:54:29.718577 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6dd299c4_05a1_4f21_ac5b_081c6f10a7f7.slice/crio-aff8dc459cd0b12326caa82f004854e4e1464fce13374d97061f06f7d5a031f4 WatchSource:0}: Error finding container aff8dc459cd0b12326caa82f004854e4e1464fce13374d97061f06f7d5a031f4: Status 404 returned error can't find the container with id aff8dc459cd0b12326caa82f004854e4e1464fce13374d97061f06f7d5a031f4 Jun 15 03:54:29.762080 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:29.762040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" event={"ID":"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7","Type":"ContainerStarted","Data":"aff8dc459cd0b12326caa82f004854e4e1464fce13374d97061f06f7d5a031f4"} Jun 15 03:54:30.240364 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:30.240333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5btpk_ddfbf611-621e-4781-8d8b-5039d88eb99b/dns/0.log" Jun 15 03:54:30.260552 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:30.260527 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5btpk_ddfbf611-621e-4781-8d8b-5039d88eb99b/kube-rbac-proxy/0.log" Jun 15 03:54:30.418917 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:30.418884 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ql7z8_ef8418f2-cd72-4c95-906c-d234ad1e5445/dns-node-resolver/0.log" Jun 15 03:54:30.770209 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:30.770166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" event={"ID":"6dd299c4-05a1-4f21-ac5b-081c6f10a7f7","Type":"ContainerStarted","Data":"a1ca86a00fdd53808ab468d106c1d131d640b482f888173a2003ed3004f5017d"} Jun 15 03:54:30.770406 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:30.770305 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:30.786086 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:30.786028 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" podStartSLOduration=1.7860077090000002 podStartE2EDuration="1.786007709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 03:54:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 03:54:30.784839931 +0000 UTC m=+2197.259775394" watchObservedRunningTime="2026-06-15 03:54:30.786007709 +0000 UTC m=+2197.260943165" Jun 15 03:54:31.002555 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:31.002525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dn248_629863d9-1ff0-47ce-bf85-38d078b40b36/node-ca/0.log" Jun 15 03:54:32.046889 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:32.046858 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79fc99d74-gzktx_fa7911c0-6dc5-4056-9d17-3e46bf4ced3c/kube-auth-proxy/0.log" Jun 15 03:54:32.247640 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:32.246666 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bd986dc6-w8m6k_b4ff6f0d-4802-479f-a1d5-f5f6f42e0405/router/0.log" Jun 15 03:54:32.901035 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:32.901004 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wl7rh_e491e7cd-4a61-448e-8494-57516ef4085c/serve-healthcheck-canary/0.log" Jun 15 03:54:33.420616 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:33.420586 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-dc2m4_4875eebb-e655-4711-9650-01eedaf5ce3c/insights-operator/0.log" Jun 15 03:54:33.421183 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:33.421153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-dc2m4_4875eebb-e655-4711-9650-01eedaf5ce3c/insights-operator/1.log" Jun 15 03:54:33.576507 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:33.576480 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qjzv8_b50e4574-40e3-4b2e-b9a9-b8b973279d77/kube-rbac-proxy/0.log" Jun 15 03:54:33.596026 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:33.596000 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qjzv8_b50e4574-40e3-4b2e-b9a9-b8b973279d77/exporter/0.log" Jun 15 03:54:33.616313 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:33.616289 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qjzv8_b50e4574-40e3-4b2e-b9a9-b8b973279d77/extractor/0.log" Jun 15 03:54:35.992810 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:35.992786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691585-7r4fg_00c7af52-1bb6-41c4-ab23-0e7d5e1a5c28/cleanup/0.log" Jun 15 03:54:36.231433 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:36.231403 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-k245g_06566df1-73a8-4a3d-a717-d75b67e3a232/manager/0.log" Jun 15 03:54:36.250656 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:36.250580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68fc7565bc-k245g_06566df1-73a8-4a3d-a717-d75b67e3a232/copy-manifests/0.log" Jun 15 03:54:36.789305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:36.789279 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hnz2l/perf-node-gather-daemonset-rww5g" Jun 15 03:54:37.946541 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:37.946512 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-94db46dd7-2pnnf_6dfaa9d5-e183-4d3d-aaab-b8d71f83f1e3/manager/0.log" Jun 15 03:54:42.329790 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:42.329763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79fc99d74-gzktx_fa7911c0-6dc5-4056-9d17-3e46bf4ced3c/kube-auth-proxy/0.log" Jun 15 03:54:42.476355 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:42.476322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bd986dc6-w8m6k_b4ff6f0d-4802-479f-a1d5-f5f6f42e0405/router/0.log" Jun 15 03:54:43.605625 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:43.605598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79fc99d74-gzktx_fa7911c0-6dc5-4056-9d17-3e46bf4ced3c/kube-auth-proxy/0.log" Jun 15 03:54:43.762305 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:43.762281 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bd986dc6-w8m6k_b4ff6f0d-4802-479f-a1d5-f5f6f42e0405/router/0.log" Jun 15 03:54:44.037427 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:44.037347 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-274n7_a6c99f55-bfb1-4e5c-bc36-77328f36133e/kube-storage-version-migrator-operator/1.log" Jun 15 03:54:44.038226 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:44.038188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-274n7_a6c99f55-bfb1-4e5c-bc36-77328f36133e/kube-storage-version-migrator-operator/0.log" Jun 15 03:54:45.455185 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.455152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79fc99d74-gzktx_fa7911c0-6dc5-4056-9d17-3e46bf4ced3c/kube-auth-proxy/0.log" Jun 15 03:54:45.566028 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.565994 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/kube-multus-additional-cni-plugins/0.log" Jun 15 03:54:45.591132 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.591107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/egress-router-binary-copy/0.log" Jun 15 03:54:45.591647 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.591629 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66bd986dc6-w8m6k_b4ff6f0d-4802-479f-a1d5-f5f6f42e0405/router/0.log" Jun 15 03:54:45.613691 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.613649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/cni-plugins/0.log" Jun 15 03:54:45.636437 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.636406 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/bond-cni-plugin/0.log" Jun 15 03:54:45.656927 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.656899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/routeoverride-cni/0.log" Jun 15 03:54:45.679422 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.679398 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/whereabouts-cni-bincopy/0.log" Jun 15 03:54:45.699979 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.699953 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kzb9f_2fa42666-b6c2-4e6e-800a-a4262affe3e9/whereabouts-cni/0.log" Jun 15 03:54:45.785453 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.785375 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zkjpr_3156802b-8294-4dda-8a42-dc5bbce1ae06/kube-multus/0.log" Jun 15 03:54:45.804350 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.804326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bk8st_50486edf-f3f6-4da6-bf76-65c1b6388548/network-metrics-daemon/0.log" Jun 15 03:54:45.822385 ip-10-0-128-105 kubenswrapper[2562]: I0615 03:54:45.822362 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bk8st_50486edf-f3f6-4da6-bf76-65c1b6388548/kube-rbac-proxy/0.log"