Jun 09 10:51:06.121252 ip-10-0-132-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 10:51:06.121262 ip-10-0-132-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 10:51:06.121269 ip-10-0-132-253 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 10:51:06.121409 ip-10-0-132-253 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 10:51:16.347753 ip-10-0-132-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 10:51:16.347771 ip-10-0-132-253 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 5379541490664a56a5d25c2165f0eb15 -- Jun 09 10:53:41.353017 ip-10-0-132-253 systemd[1]: Starting Kubernetes Kubelet... Jun 09 10:53:41.705755 ip-10-0-132-253 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 10:53:41.705755 ip-10-0-132-253 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 10:53:41.705755 ip-10-0-132-253 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 10:53:41.705755 ip-10-0-132-253 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 10:53:41.705755 ip-10-0-132-253 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 10:53:41.707326 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.707243 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 10:53:41.711323 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711307 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:41.711323 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711322 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:41.711323 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711326 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711329 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711332 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711335 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711338 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711340 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711343 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711345 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711348 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711351 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711360 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711363 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711366 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711368 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711371 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711373 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711375 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711378 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711380 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711383 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:41.711414 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711386 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711388 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711391 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711394 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711396 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711399 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711401 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711403 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711406 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711409 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711412 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711415 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711417 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711420 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711423 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711426 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711429 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711432 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711434 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711437 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:41.711924 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711439 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711442 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711444 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711447 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711449 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711452 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711454 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711457 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711459 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711462 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711465 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711467 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711470 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711472 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711476 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711478 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711483 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711486 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711488 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:41.712412 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711491 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711494 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711496 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711498 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711501 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711504 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711506 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711508 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711511 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711514 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711518 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711522 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711525 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711528 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711530 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711533 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711535 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711538 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711541 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:41.712934 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711545 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711549 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711552 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711555 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711557 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711560 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711563 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711566 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711568 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711571 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711573 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711577 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711580 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711583 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711586 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711589 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711592 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.711594 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712306 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712312 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:41.713400 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712315 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712318 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712320 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712323 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712326 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712329 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712331 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712334 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712336 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712339 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712341 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712344 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712347 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712349 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712352 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712355 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712357 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712359 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712362 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712366 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:41.713889 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712368 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712371 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712375 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712379 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712381 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712384 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712387 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712389 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712392 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712395 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712398 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712401 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712403 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712407 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712411 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712413 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712418 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712422 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712425 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:41.714418 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712428 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712431 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712433 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712436 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712439 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712442 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712444 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712447 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712450 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712453 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712455 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712457 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712460 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712463 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712465 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712468 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712470 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712473 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712475 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:41.714916 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712478 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712480 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712483 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712485 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712487 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712490 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712492 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712494 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712497 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712499 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712502 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712505 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712507 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712510 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712512 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712515 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712518 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712521 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712523 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712525 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:41.715390 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712528 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712531 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712533 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712536 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712538 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712541 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712544 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712547 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712550 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712552 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712555 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712557 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712560 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712562 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712565 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712567 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712570 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712572 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.712574 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713615 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:41.715901 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713623 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713626 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713629 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713633 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713637 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713642 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713645 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713649 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713652 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713655 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713657 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713660 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713664 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713667 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713669 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713672 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713674 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713677 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713681 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:41.716397 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713684 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713687 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713689 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713692 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713695 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713697 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713700 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713702 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713705 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713707 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713710 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713712 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713715 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713718 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713720 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713723 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713726 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713730 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713733 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713735 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:41.716933 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713738 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713740 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713743 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713745 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713748 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713750 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713753 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713755 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713758 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713761 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713763 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713765 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713768 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713770 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713773 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713775 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713777 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713780 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713782 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713784 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:41.717427 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713787 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713789 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713792 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713796 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713801 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713803 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713806 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713808 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713811 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713814 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713817 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713821 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713824 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713827 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713830 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713832 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713835 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713838 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713840 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:41.717982 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713842 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713845 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713847 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713850 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713852 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713854 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713857 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713860 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713863 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713865 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713867 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713870 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713872 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713875 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713877 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713879 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713882 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713889 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713892 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.713894 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:41.718457 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.713969 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.713984 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.713990 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.713995 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714000 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714003 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714007 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714011 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714014 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714018 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714021 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714024 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714027 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714030 2562 flags.go:64] FLAG: --cgroup-root="" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714033 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714036 2562 flags.go:64] FLAG: --client-ca-file="" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714039 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714042 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714046 2562 flags.go:64] FLAG: --cluster-domain="" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714049 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714052 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714055 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714058 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714062 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 10:53:41.718978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714064 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714067 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714070 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714073 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714076 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714080 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714086 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714088 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714092 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714095 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714098 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714101 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714104 2562 flags.go:64] FLAG: --enable-server="true" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714107 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714112 2562 flags.go:64] FLAG: --event-burst="100" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714115 2562 flags.go:64] FLAG: --event-qps="50" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714118 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714121 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714123 2562 flags.go:64] FLAG: --eviction-hard="" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714127 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714130 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714133 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714136 2562 flags.go:64] FLAG: --eviction-soft="" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714139 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714141 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 10:53:41.719565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714145 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714147 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714150 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714153 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714156 2562 flags.go:64] FLAG: --feature-gates="" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714159 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714162 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714165 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714168 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714172 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714174 2562 flags.go:64] FLAG: --help="false" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714177 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-132-253.ec2.internal" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714181 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714185 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714188 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714191 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714194 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714197 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714199 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714202 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714205 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714209 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714211 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714214 2562 flags.go:64] FLAG: --kube-reserved="" Jun 09 10:53:41.720212 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714217 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714219 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714222 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714225 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714227 2562 flags.go:64] FLAG: --lock-file="" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714230 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714233 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714237 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714242 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714245 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714247 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714250 2562 flags.go:64] FLAG: --logging-format="text" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714253 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714256 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714258 2562 flags.go:64] FLAG: --manifest-url="" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714261 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714265 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714268 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714272 2562 flags.go:64] FLAG: --max-pods="110" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714274 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714277 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714281 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714284 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714287 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714289 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 10:53:41.720865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714293 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714299 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714302 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714305 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714308 2562 flags.go:64] FLAG: --pod-cidr="" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714311 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714317 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714320 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714322 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714325 2562 flags.go:64] FLAG: --port="10250" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714328 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714331 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ae2433fd8896ee1b" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714334 2562 flags.go:64] FLAG: --qos-reserved="" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714337 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714340 2562 flags.go:64] FLAG: --register-node="true" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714343 2562 flags.go:64] FLAG: --register-with-taints="" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714346 2562 flags.go:64] FLAG: --registry-burst="10" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714349 2562 flags.go:64] FLAG: --registry-qps="5" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714352 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714354 2562 flags.go:64] FLAG: --reserved-memory="" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714358 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714360 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714363 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714366 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714368 2562 flags.go:64] FLAG: --runonce="false" Jun 09 10:53:41.721485 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714371 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714374 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714377 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714379 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714383 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714386 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714389 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714392 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714394 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714397 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714400 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714402 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714405 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714409 2562 flags.go:64] FLAG: --system-cgroups="" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714411 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714416 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714419 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714422 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714427 2562 flags.go:64] FLAG: --tls-min-version="" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714430 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714434 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714436 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714439 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714442 2562 flags.go:64] FLAG: --v="2" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714446 2562 flags.go:64] FLAG: --version="false" Jun 09 10:53:41.722105 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714450 2562 flags.go:64] FLAG: --vmodule="" Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714453 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714457 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714570 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714574 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714577 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714580 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714582 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714587 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714590 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714593 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714597 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714618 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714622 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714627 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714630 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714632 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714635 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714638 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:41.722754 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714640 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714643 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714646 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714649 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714651 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714654 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714657 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714660 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714664 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714666 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714669 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714672 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714674 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714677 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714679 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714682 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714684 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714687 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714689 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714692 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:41.723232 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714694 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714697 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714699 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714702 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714706 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714709 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714711 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714714 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714717 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714720 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714722 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714725 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714728 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714730 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714733 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714736 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714739 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714741 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714744 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714746 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:41.723767 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714750 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714752 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714755 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714757 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714759 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714762 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714765 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714767 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714769 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714772 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714775 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714777 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714779 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714782 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714784 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714786 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714790 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714793 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714795 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714798 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:41.724256 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714801 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714803 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714806 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714808 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714810 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714814 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714817 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714820 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714823 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714826 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714828 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714831 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714835 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714838 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714842 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714845 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714847 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714849 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714852 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:41.724776 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714854 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714857 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714859 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.714861 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.714867 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.721495 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.721511 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.721530 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.721535 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721592 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721597 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721616 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721620 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721623 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:41.725239 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721626 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721628 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721631 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721633 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721636 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721638 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721641 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721643 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721646 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721648 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721651 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721654 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721656 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721659 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721661 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721664 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721666 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721669 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721671 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721674 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:41.725589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721676 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721679 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721681 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721684 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721688 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721691 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721693 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721696 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721698 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721701 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721703 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721706 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721709 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721711 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721713 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721716 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721718 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721721 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721723 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:41.726135 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721725 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721729 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721732 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721735 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721737 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721740 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721742 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721744 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721747 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721749 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721752 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721754 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721757 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721759 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721761 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721764 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721766 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721770 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721773 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:41.726634 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721776 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721778 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721781 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721783 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721786 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721789 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721791 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721794 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721796 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721800 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721803 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721805 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721808 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721810 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721813 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721815 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721817 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721820 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721822 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721825 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:41.727107 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721827 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721829 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721832 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721834 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721836 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721839 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721842 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721844 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721847 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721849 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721852 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721855 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721858 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721861 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721863 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:41.727597 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721865 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.721871 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721984 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721989 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721992 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721995 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.721998 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722000 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722004 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722006 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722009 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722013 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722017 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722020 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722023 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 10:53:41.728226 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722025 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722027 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722030 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722032 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722035 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722037 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722039 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722042 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722045 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722047 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722050 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722052 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722055 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722057 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722059 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722062 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722065 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722067 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722070 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722072 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 10:53:41.728629 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722075 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722078 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722080 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722083 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722085 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722088 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722090 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722093 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722095 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722098 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722101 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722105 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722108 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722111 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722114 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722117 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722120 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722123 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722126 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 10:53:41.729233 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722130 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722133 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722136 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722138 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722141 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722144 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722146 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722149 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722151 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722154 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722157 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722160 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722163 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722166 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722169 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722172 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722174 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722177 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722179 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 10:53:41.729955 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722181 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722184 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722186 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722189 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722191 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722193 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722196 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722198 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722201 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722203 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722206 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722208 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722210 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722213 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722215 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722218 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722220 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722222 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722225 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722228 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 10:53:41.730556 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722230 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722233 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722235 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722238 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722241 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722243 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722245 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:41.722248 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.722253 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.722358 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.724661 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.725781 2562 server.go:1019] "Starting client certificate rotation" Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.725884 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 10:53:41.731076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.725920 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 10:53:41.731439 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.728026 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 10:53:41.732925 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.732907 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 10:53:41.742488 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.742471 2562 log.go:25] "Validated CRI v1 runtime API" Jun 09 10:53:41.745455 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.745440 2562 log.go:25] "Validated CRI v1 image API" Jun 09 10:53:41.746221 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.746203 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 10:53:41.748539 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.748521 2562 fs.go:135] Filesystem UUIDs: map[351aa717-1236-4a0f-a4d8-e5280c8eefdd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d4ef1f88-a977-4902-af14-b79daac3433e:/dev/nvme0n1p3] Jun 09 10:53:41.748592 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.748539 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 10:53:41.752834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.752712 2562 manager.go:216] Machine: {Timestamp:2026-06-09 10:53:41.752202777 +0000 UTC m=+0.285757849 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111713 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27772332442e0fce233678cb4774e7 SystemUUID:ec277723-3244-2e0f-ce23-3678cb4774e7 BootID:53795414-9066-4a56-a5d2-5c2165f0eb15 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:81:f4:e9:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:81:f4:e9:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:39:33:ea:46:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 10:53:41.752834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.752833 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 10:53:41.752946 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.752905 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 10:53:41.756356 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.756315 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 10:53:41.756581 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.756362 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 10:53:41.756690 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.756675 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 10:53:41.757211 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.757198 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 10:53:41.757251 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.757213 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 10:53:41.757251 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.757221 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 10:53:41.758698 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.758687 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 10:53:41.759780 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.759770 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 10:53:41.764077 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764065 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 10:53:41.764195 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764185 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 10:53:41.764240 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764215 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 09 10:53:41.764240 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764226 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 10:53:41.764308 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764240 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 10:53:41.764308 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764251 2562 kubelet.go:398] "Adding apiserver pod source" Jun 09 10:53:41.764308 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764260 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 10:53:41.764695 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764681 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 10:53:41.764735 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.764707 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 10:53:41.769144 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.769118 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 10:53:41.771471 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.771457 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 10:53:41.771524 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.771488 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 10:53:41.773005 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.772993 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 10:53:41.773046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773012 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 10:53:41.773046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773018 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 10:53:41.773046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773024 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 10:53:41.773046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773033 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 10:53:41.773046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773038 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 10:53:41.773046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773047 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 10:53:41.773242 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773052 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 10:53:41.773242 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773058 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 10:53:41.773242 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773064 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 10:53:41.773242 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773071 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 10:53:41.773242 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.773076 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 10:53:41.774826 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.774814 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 10:53:41.774858 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.774829 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 10:53:41.778220 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.778206 2562 server.go:1268] "Started kubelet" Jun 09 10:53:41.778348 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.778312 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 10:53:41.778431 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.778325 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 10:53:41.778477 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.778452 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 10:53:41.779082 ip-10-0-132-253 systemd[1]: Started Kubernetes Kubelet. Jun 09 10:53:41.782263 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.782226 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 10:53:41.782371 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.782272 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 10:53:41.782371 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.782344 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 10:53:41.788538 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.788519 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 09 10:53:41.788954 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.788935 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 10:53:41.789404 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.789383 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 10:53:41.792514 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.791395 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18b764443632e9ac default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-06-09 10:53:41.778180524 +0000 UTC m=+0.311735597,LastTimestamp:2026-06-09 10:53:41.778180524 +0000 UTC m=+0.311735597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}" Jun 09 10:53:41.795219 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.795202 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 10:53:41.795292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.795221 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 10:53:41.795347 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.795305 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:41.795992 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.795971 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 10:53:41.795992 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.795981 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 10:53:41.795992 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.795992 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 10:53:41.796178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.795992 2562 factory.go:55] Registering systemd factory Jun 09 10:53:41.796178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796033 2562 factory.go:223] Registration of the systemd container factory successfully Jun 09 10:53:41.796178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796092 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 09 10:53:41.796178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796101 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 09 10:53:41.796390 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796377 2562 factory.go:153] Registering CRI-O factory Jun 09 10:53:41.796453 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796395 2562 factory.go:223] Registration of the crio container factory successfully Jun 09 10:53:41.796453 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796449 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 10:53:41.796531 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796468 2562 factory.go:103] Registering Raw factory Jun 09 10:53:41.796531 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796482 2562 manager.go:1196] Started watching for new ooms in manager Jun 09 10:53:41.796970 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.796957 2562 manager.go:349] Starting recovery of all containers Jun 09 10:53:41.799947 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.799923 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 10:53:41.800386 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.800364 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 10:53:41.804291 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.804263 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpq8q" Jun 09 10:53:41.809173 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.809149 2562 manager.go:354] Recovery completed Jun 09 10:53:41.812925 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.812909 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cpq8q" Jun 09 10:53:41.813764 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.813751 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.815964 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.815943 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.816029 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.815984 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.816029 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.816003 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.816576 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.816558 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 10:53:41.816576 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.816575 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 10:53:41.816724 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.816592 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 10:53:41.816724 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.816575 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.817423 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.817409 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.817484 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.817436 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.817484 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.817445 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.818402 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.818337 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-253.ec2.internal.18b764443873746a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-253.ec2.internal,UID:ip-10-0-132-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-253.ec2.internal,},FirstTimestamp:2026-06-09 10:53:41.815964778 +0000 UTC m=+0.349520039,LastTimestamp:2026-06-09 10:53:41.815964778 +0000 UTC m=+0.349520039,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-253.ec2.internal,}" Jun 09 10:53:41.818589 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.818578 2562 policy_none.go:49] "None policy: Start" Jun 09 10:53:41.818652 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.818595 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 10:53:41.818652 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.818618 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 10:53:41.820618 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.820589 2562 policy_none.go:47] "Start" Jun 09 10:53:41.863214 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863192 2562 manager.go:337] "Starting Device Plugin manager" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.863227 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863237 2562 server.go:87] "Starting device plugin registration server" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863482 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863492 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863647 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863765 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.863775 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.864197 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.864255 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.868165 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.869629 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.869672 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.869694 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.869755 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 10:53:41.877079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.871444 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:41.964003 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.963932 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.965007 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.964965 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.965007 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.965006 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.965167 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.965017 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.965167 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.965042 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-253.ec2.internal" Jun 09 10:53:41.969980 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.969960 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal"] Jun 09 10:53:41.970058 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.970045 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.971555 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.971540 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.971626 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.971566 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.971626 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.971575 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.972833 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.972814 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-253.ec2.internal" Jun 09 10:53:41.972878 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.972838 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-253.ec2.internal\": node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:41.973790 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.973778 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.973890 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.973877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:41.973934 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.973905 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.974494 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.974478 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.974494 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.974492 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.974581 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.974509 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.974581 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.974514 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.974581 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.974520 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.974581 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.974524 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.976675 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.976656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jun 09 10:53:41.976761 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.976697 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 10:53:41.977349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.977334 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientMemory" Jun 09 10:53:41.977391 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.977365 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 10:53:41.977391 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:41.977380 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeHasSufficientPID" Jun 09 10:53:41.988913 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:41.988890 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.001400 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.001378 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.005995 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.005979 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-253.ec2.internal\" not found" node="ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.089025 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.088992 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.097729 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.097707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7952f9e65afac5824d2c2c83b0d6b99f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"7952f9e65afac5824d2c2c83b0d6b99f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.097837 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.097736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f3f172483b82b15e1c613215208aaa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"5f3f172483b82b15e1c613215208aaa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.097837 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.097759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3f172483b82b15e1c613215208aaa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"5f3f172483b82b15e1c613215208aaa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.190035 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.189994 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.198358 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.198318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7952f9e65afac5824d2c2c83b0d6b99f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"7952f9e65afac5824d2c2c83b0d6b99f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.198423 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.198375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f3f172483b82b15e1c613215208aaa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"5f3f172483b82b15e1c613215208aaa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.198423 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.198395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3f172483b82b15e1c613215208aaa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"5f3f172483b82b15e1c613215208aaa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.198503 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.198343 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7952f9e65afac5824d2c2c83b0d6b99f-config\") pod \"kube-apiserver-proxy-ip-10-0-132-253.ec2.internal\" (UID: \"7952f9e65afac5824d2c2c83b0d6b99f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.198503 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.198433 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5f3f172483b82b15e1c613215208aaa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"5f3f172483b82b15e1c613215208aaa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.198503 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.198470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5f3f172483b82b15e1c613215208aaa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal\" (UID: \"5f3f172483b82b15e1c613215208aaa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.290852 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.290760 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.307249 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.307229 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.312543 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.311815 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jun 09 10:53:42.391181 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.391124 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.491658 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.491622 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.592270 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.592171 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.692797 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.692758 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.725317 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.725284 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 10:53:42.725902 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.725448 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 10:53:42.793557 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.793366 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.816831 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.816793 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 10:48:41 +0000 UTC" deadline="2027-11-12 04:06:41.021390638 +0000 UTC" Jun 09 10:53:42.816831 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.816825 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12497h12m58.204569177s" Jun 09 10:53:42.894077 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.894044 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:42.894462 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:42.894438 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7952f9e65afac5824d2c2c83b0d6b99f.slice/crio-b5fd9d50f4c2aab6b9187e666a217b07c310c4522b36f3db5ebe4e23b7d2a94c WatchSource:0}: Error finding container b5fd9d50f4c2aab6b9187e666a217b07c310c4522b36f3db5ebe4e23b7d2a94c: Status 404 returned error can't find the container with id b5fd9d50f4c2aab6b9187e666a217b07c310c4522b36f3db5ebe4e23b7d2a94c Jun 09 10:53:42.894963 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:42.894943 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f3f172483b82b15e1c613215208aaa9.slice/crio-ebf220fe24ab25b5addcd230d4206962d6c02ccd1b27980c0b3ad2c50f9670b4 WatchSource:0}: Error finding container ebf220fe24ab25b5addcd230d4206962d6c02ccd1b27980c0b3ad2c50f9670b4: Status 404 returned error can't find the container with id ebf220fe24ab25b5addcd230d4206962d6c02ccd1b27980c0b3ad2c50f9670b4 Jun 09 10:53:42.900367 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:42.900348 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 10:53:42.994200 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:42.994164 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-253.ec2.internal\" not found" Jun 09 10:53:43.036451 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.036422 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:43.093892 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.093866 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:43.095496 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.095480 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" Jun 09 10:53:43.104133 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.104112 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 10:53:43.106203 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.106186 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" Jun 09 10:53:43.116974 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.116952 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 10:53:43.368962 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.368879 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:43.765694 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.765593 2562 apiserver.go:52] "Watching apiserver" Jun 09 10:53:43.779171 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.778257 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 10:53:43.779171 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.778804 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-qf8zc","kube-system/global-pull-secret-syncer-rwwrq","openshift-image-registry/node-ca-52lmc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal","openshift-multus/multus-additional-cni-plugins-v9snq","openshift-multus/network-metrics-daemon-68ngr","openshift-network-diagnostics/network-check-target-hz4hn","openshift-network-operator/iptables-alerter-qnfkl","kube-system/konnectivity-agent-2b68l","kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz","openshift-cluster-node-tuning-operator/tuned-htd7f","openshift-dns/node-resolver-v5d2p","openshift-multus/multus-nzzd5"] Jun 09 10:53:43.781580 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.781547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.784096 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.784073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:43.784234 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.784146 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:43.784829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.784683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.784829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.784716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 10:53:43.784970 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.784931 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v775l\"" Jun 09 10:53:43.786318 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.786067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.787952 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.787930 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.788281 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.788249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.788538 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.788520 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 10:53:43.788856 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.788829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-cw4h9\"" Jun 09 10:53:43.788939 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.788882 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.788994 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.788838 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.789065 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.789051 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 10:53:43.790713 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.790421 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.790713 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.790505 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:43.791037 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.791020 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.791162 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.791133 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.791330 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.791316 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9wbth\"" Jun 09 10:53:43.792813 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.792793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.795122 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.795097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.795215 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.795127 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-j9qzh\"" Jun 09 10:53:43.795351 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.795333 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 10:53:43.795661 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.795642 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 10:53:43.796782 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.796761 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.796884 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.796835 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 10:53:43.796884 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.796856 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 10:53:43.797034 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.797016 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 10:53:43.797100 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.797083 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.797392 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.797377 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 10:53:43.797771 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.797685 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhkwb\"" Jun 09 10:53:43.797771 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.797717 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 10:53:43.798533 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.798513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:43.798677 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.798588 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:43.801019 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.800999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:43.803285 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.803260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:43.803482 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.803464 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.803732 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.803719 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 10:53:43.803823 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.803810 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.804034 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.804016 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hkx95\"" Jun 09 10:53:43.805918 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.805844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.806177 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e955645-c813-4671-bbbd-d0286e634ff3-kubelet-config\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.806232 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-systemd-units\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.806232 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-kubelet\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.806306 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-conf-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.806306 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84c68892-e535-4ac8-830c-ebbbdf45b576-cni-binary-copy\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.806442 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806307 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.806442 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-var-lib-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.806442 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806378 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-cni-bin\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.806442 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovn-node-metrics-cert\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.806442 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4067ca-255e-4b08-8261-7d6ed46fda30-host\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.806678 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-cnibin\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.806678 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e955645-c813-4671-bbbd-d0286e634ff3-dbus\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.806790 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zg9\" (UniqueName: \"kubernetes.io/projected/94cb6419-6a25-4b96-84d1-2a02f31858d9-kube-api-access-99zg9\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.806859 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806843 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cnibin\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.806912 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-cni-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.806965 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.806924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shdng\" (UniqueName: \"kubernetes.io/projected/84c68892-e535-4ac8-830c-ebbbdf45b576-kube-api-access-shdng\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.807375 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-etc-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.807432 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807397 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-cni-netd\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.807480 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-multus-certs\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.807533 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807493 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-kubelet\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.807533 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-ovn\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.807667 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-env-overrides\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.807667 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:43.807761 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.807665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:43.808174 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc686\" (UniqueName: \"kubernetes.io/projected/a3dc867a-3781-47bf-bb81-47ee2896dcee-kube-api-access-nc686\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.808244 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovnkube-script-lib\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.808244 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd4067ca-255e-4b08-8261-7d6ed46fda30-serviceca\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.808349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-socket-dir-parent\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.808349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-k8s-cni-cncf-io\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.808349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-netns\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.808495 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-daemon-config\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.808495 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808407 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-slash\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.808495 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-node-log\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.808665 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3dc867a-3781-47bf-bb81-47ee2896dcee-hosts-file\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.808665 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf8rg\" (UniqueName: \"kubernetes.io/projected/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-kube-api-access-wf8rg\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.808665 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbbcs\" (UniqueName: \"kubernetes.io/projected/fd4067ca-255e-4b08-8261-7d6ed46fda30-kube-api-access-dbbcs\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.808849 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 10:53:43.808906 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808864 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.808958 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-os-release\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.809004 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.808982 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-cni-bin\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.809051 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-log-socket\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.809051 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-run-netns\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.809268 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809243 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 10:53:43.809336 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.809336 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.809434 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-etc-kubernetes\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.809434 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.809434 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809400 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b5whk\"" Jun 09 10:53:43.809434 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59s5\" (UniqueName: \"kubernetes.io/projected/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-kube-api-access-n59s5\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:43.809639 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-system-cni-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.809639 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.809639 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-hostroot\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.809773 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-cni-multus\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.809885 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovnkube-config\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.809953 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-os-release\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.810002 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.809970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-systemd\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.810064 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.810048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.810112 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.810082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.810165 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.810147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-system-cni-dir\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.810353 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.810333 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 10:53:43.810484 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.810455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3dc867a-3781-47bf-bb81-47ee2896dcee-tmp-dir\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.810552 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.810531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.811588 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.811568 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 10:53:43.812196 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.812075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.812267 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.812257 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 10:53:43.812369 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.812318 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.813073 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.813052 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 10:53:43.813161 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.813078 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4s8k9\"" Jun 09 10:53:43.813213 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.813175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6drtw\"" Jun 09 10:53:43.829515 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.829490 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zmrv6" Jun 09 10:53:43.838367 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.838344 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zmrv6" Jun 09 10:53:43.851787 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.851764 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 10:53:43.874204 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.874151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"5f3f172483b82b15e1c613215208aaa9","Type":"ContainerStarted","Data":"ebf220fe24ab25b5addcd230d4206962d6c02ccd1b27980c0b3ad2c50f9670b4"} Jun 09 10:53:43.875420 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.875384 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" event={"ID":"7952f9e65afac5824d2c2c83b0d6b99f","Type":"ContainerStarted","Data":"b5fd9d50f4c2aab6b9187e666a217b07c310c4522b36f3db5ebe4e23b7d2a94c"} Jun 09 10:53:43.897007 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.896971 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 10:53:43.911019 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.910981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e955645-c813-4671-bbbd-d0286e634ff3-kubelet-config\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.911019 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-systemd-units\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-kubelet\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-conf-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-systemd-units\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911124 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-conf-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84c68892-e535-4ac8-830c-ebbbdf45b576-cni-binary-copy\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9e955645-c813-4671-bbbd-d0286e634ff3-kubelet-config\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-kubelet\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.911374 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-var-lib-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911424 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-cni-bin\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.911469 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:44.411437276 +0000 UTC m=+2.944992349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-cni-bin\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovn-node-metrics-cert\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4067ca-255e-4b08-8261-7d6ed46fda30-host\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-cnibin\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-var-lib-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901435a6-7ad3-46f7-a6ac-1e1510bbd468-host-slash\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e955645-c813-4671-bbbd-d0286e634ff3-dbus\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zg9\" (UniqueName: \"kubernetes.io/projected/94cb6419-6a25-4b96-84d1-2a02f31858d9-kube-api-access-99zg9\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cnibin\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-cni-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shdng\" (UniqueName: \"kubernetes.io/projected/84c68892-e535-4ac8-830c-ebbbdf45b576-kube-api-access-shdng\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-registration-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cvjb\" (UniqueName: \"kubernetes.io/projected/0d288d7a-11aa-4135-9732-0205bafc99db-kube-api-access-2cvjb\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-host\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-etc-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-cni-netd\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911807 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-multus-certs\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.911829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911823 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-device-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-etc-selinux\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84c68892-e535-4ac8-830c-ebbbdf45b576-cni-binary-copy\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-tuned\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-kubelet\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911913 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-ovn\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911915 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911942 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-env-overrides\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-cnibin\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9e955645-c813-4671-bbbd-d0286e634ff3-dbus\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-sys\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc686\" (UniqueName: \"kubernetes.io/projected/a3dc867a-3781-47bf-bb81-47ee2896dcee-kube-api-access-nc686\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovnkube-script-lib\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd4067ca-255e-4b08-8261-7d6ed46fda30-serviceca\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-socket-dir-parent\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.911937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4067ca-255e-4b08-8261-7d6ed46fda30-host\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.912476 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-cni-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-socket-dir-parent\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-etc-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-cni-netd\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-multus-certs\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.912410 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.912456 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:44.412441086 +0000 UTC m=+2.945996144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-k8s-cni-cncf-io\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-netns\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-daemon-config\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912550 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cnibin\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912631 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-kubelet\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-slash\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-node-log\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysctl-d\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-netns\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.913452 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3dc867a-3781-47bf-bb81-47ee2896dcee-hosts-file\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf8rg\" (UniqueName: \"kubernetes.io/projected/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-kube-api-access-wf8rg\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbbcs\" (UniqueName: \"kubernetes.io/projected/fd4067ca-255e-4b08-8261-7d6ed46fda30-kube-api-access-dbbcs\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-os-release\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-cni-bin\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-kubernetes\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912943 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3990f58-c53e-4831-bf62-a7eca7bc5088-tmp\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-log-socket\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-systemd\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fd4067ca-255e-4b08-8261-7d6ed46fda30-serviceca\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-run-netns\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-etc-kubernetes\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84c68892-e535-4ac8-830c-ebbbdf45b576-multus-daemon-config\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-env-overrides\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.912695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-ovn\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.914323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913172 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovnkube-script-lib\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-slash\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-etc-kubernetes\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-run-k8s-cni-cncf-io\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a3dc867a-3781-47bf-bb81-47ee2896dcee-hosts-file\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-run-netns\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-cni-bin\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-openvswitch\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-node-log\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n59s5\" (UniqueName: \"kubernetes.io/projected/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-kube-api-access-n59s5\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-log-socket\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913545 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-os-release\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.913979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-system-cni-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901435a6-7ad3-46f7-a6ac-1e1510bbd468-iptables-alerter-script\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:43.915152 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-system-cni-dir\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmzr8\" (UniqueName: \"kubernetes.io/projected/901435a6-7ad3-46f7-a6ac-1e1510bbd468-kube-api-access-xmzr8\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914350 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysconfig\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-hostroot\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-socket-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-var-lib-kubelet\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-cni-multus\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-hostroot\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovnkube-config\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-os-release\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a078ff6a-217c-4872-8c66-033d64348007-konnectivity-ca\") pod \"konnectivity-agent-2b68l\" (UID: \"a078ff6a-217c-4872-8c66-033d64348007\") " pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84c68892-e535-4ac8-830c-ebbbdf45b576-host-var-lib-cni-multus\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-lib-modules\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914641 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-os-release\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-systemd\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.915878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-modprobe-d\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-run-systemd\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-system-cni-dir\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914828 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysctl-conf\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-run\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3dc867a-3781-47bf-bb81-47ee2896dcee-tmp-dir\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-system-cni-dir\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a078ff6a-217c-4872-8c66-033d64348007-agent-certs\") pod \"konnectivity-agent-2b68l\" (UID: \"a078ff6a-217c-4872-8c66-033d64348007\") " pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.914991 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94cb6419-6a25-4b96-84d1-2a02f31858d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.915003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-sys-fs\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.915027 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovnkube-config\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.915030 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvvc\" (UniqueName: \"kubernetes.io/projected/a3990f58-c53e-4831-bf62-a7eca7bc5088-kube-api-access-ztvvc\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.915244 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cni-binary-copy\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.915257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a3dc867a-3781-47bf-bb81-47ee2896dcee-tmp-dir\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.916466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.915505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.917113 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.916085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94cb6419-6a25-4b96-84d1-2a02f31858d9-ovn-node-metrics-cert\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.921062 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.921040 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:43.921062 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.921065 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:43.921238 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.921079 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:43.921238 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:43.921156 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:44.421143181 +0000 UTC m=+2.954698238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:43.923596 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.923572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zg9\" (UniqueName: \"kubernetes.io/projected/94cb6419-6a25-4b96-84d1-2a02f31858d9-kube-api-access-99zg9\") pod \"ovnkube-node-qf8zc\" (UID: \"94cb6419-6a25-4b96-84d1-2a02f31858d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:43.924282 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.924238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf8rg\" (UniqueName: \"kubernetes.io/projected/383e5937-c0dd-4aed-854e-0f2d0aeb54f6-kube-api-access-wf8rg\") pod \"multus-additional-cni-plugins-v9snq\" (UID: \"383e5937-c0dd-4aed-854e-0f2d0aeb54f6\") " pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:43.925742 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.925714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc686\" (UniqueName: \"kubernetes.io/projected/a3dc867a-3781-47bf-bb81-47ee2896dcee-kube-api-access-nc686\") pod \"node-resolver-v5d2p\" (UID: \"a3dc867a-3781-47bf-bb81-47ee2896dcee\") " pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:43.926367 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.926339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59s5\" (UniqueName: \"kubernetes.io/projected/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-kube-api-access-n59s5\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:43.927147 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.927130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbbcs\" (UniqueName: \"kubernetes.io/projected/fd4067ca-255e-4b08-8261-7d6ed46fda30-kube-api-access-dbbcs\") pod \"node-ca-52lmc\" (UID: \"fd4067ca-255e-4b08-8261-7d6ed46fda30\") " pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:43.927332 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:43.927316 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-shdng\" (UniqueName: \"kubernetes.io/projected/84c68892-e535-4ac8-830c-ebbbdf45b576-kube-api-access-shdng\") pod \"multus-nzzd5\" (UID: \"84c68892-e535-4ac8-830c-ebbbdf45b576\") " pod="openshift-multus/multus-nzzd5" Jun 09 10:53:44.015355 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a078ff6a-217c-4872-8c66-033d64348007-agent-certs\") pod \"konnectivity-agent-2b68l\" (UID: \"a078ff6a-217c-4872-8c66-033d64348007\") " pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-sys-fs\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvvc\" (UniqueName: \"kubernetes.io/projected/a3990f58-c53e-4831-bf62-a7eca7bc5088-kube-api-access-ztvvc\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901435a6-7ad3-46f7-a6ac-1e1510bbd468-host-slash\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-registration-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015465 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-sys-fs\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cvjb\" (UniqueName: \"kubernetes.io/projected/0d288d7a-11aa-4135-9732-0205bafc99db-kube-api-access-2cvjb\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015513 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-host\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901435a6-7ad3-46f7-a6ac-1e1510bbd468-host-slash\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-device-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-etc-selinux\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-device-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-tuned\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-host\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-etc-selinux\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015667 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-sys\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-registration-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysctl-d\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-kubernetes\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-sys\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysctl-d\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3990f58-c53e-4831-bf62-a7eca7bc5088-tmp\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.015957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-kubernetes\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-systemd\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-systemd\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901435a6-7ad3-46f7-a6ac-1e1510bbd468-iptables-alerter-script\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmzr8\" (UniqueName: \"kubernetes.io/projected/901435a6-7ad3-46f7-a6ac-1e1510bbd468-kube-api-access-xmzr8\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysconfig\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.015978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-socket-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-var-lib-kubelet\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a078ff6a-217c-4872-8c66-033d64348007-konnectivity-ca\") pod \"konnectivity-agent-2b68l\" (UID: \"a078ff6a-217c-4872-8c66-033d64348007\") " pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-lib-modules\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-modprobe-d\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysctl-conf\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-run\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-run\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-lib-modules\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-modprobe-d\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901435a6-7ad3-46f7-a6ac-1e1510bbd468-iptables-alerter-script\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.016770 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysctl-conf\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.017354 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0d288d7a-11aa-4135-9732-0205bafc99db-socket-dir\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.017354 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016680 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-sysconfig\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.017354 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a078ff6a-217c-4872-8c66-033d64348007-konnectivity-ca\") pod \"konnectivity-agent-2b68l\" (UID: \"a078ff6a-217c-4872-8c66-033d64348007\") " pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:44.017354 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.016796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a3990f58-c53e-4831-bf62-a7eca7bc5088-var-lib-kubelet\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.018131 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.018097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a078ff6a-217c-4872-8c66-033d64348007-agent-certs\") pod \"konnectivity-agent-2b68l\" (UID: \"a078ff6a-217c-4872-8c66-033d64348007\") " pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:44.018468 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.018448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a3990f58-c53e-4831-bf62-a7eca7bc5088-tmp\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.018855 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.018833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a3990f58-c53e-4831-bf62-a7eca7bc5088-etc-tuned\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.024237 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.024215 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvvc\" (UniqueName: \"kubernetes.io/projected/a3990f58-c53e-4831-bf62-a7eca7bc5088-kube-api-access-ztvvc\") pod \"tuned-htd7f\" (UID: \"a3990f58-c53e-4831-bf62-a7eca7bc5088\") " pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.024466 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.024438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cvjb\" (UniqueName: \"kubernetes.io/projected/0d288d7a-11aa-4135-9732-0205bafc99db-kube-api-access-2cvjb\") pod \"aws-ebs-csi-driver-node-skhzz\" (UID: \"0d288d7a-11aa-4135-9732-0205bafc99db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.024688 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.024669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmzr8\" (UniqueName: \"kubernetes.io/projected/901435a6-7ad3-46f7-a6ac-1e1510bbd468-kube-api-access-xmzr8\") pod \"iptables-alerter-qnfkl\" (UID: \"901435a6-7ad3-46f7-a6ac-1e1510bbd468\") " pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.094701 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.094663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-52lmc" Jun 09 10:53:44.102846 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.102823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nzzd5" Jun 09 10:53:44.114495 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.114474 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v5d2p" Jun 09 10:53:44.119996 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.119974 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:53:44.125651 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.125632 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v9snq" Jun 09 10:53:44.132168 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.132147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qnfkl" Jun 09 10:53:44.138711 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.138692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:53:44.144408 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.144389 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" Jun 09 10:53:44.150150 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.150133 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-htd7f" Jun 09 10:53:44.419393 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.419316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:44.419393 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.419372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:44.419556 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.419475 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:44.419556 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.419488 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:44.419640 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.419558 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:45.41953735 +0000 UTC m=+3.953092411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:44.419640 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.419581 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:45.419570369 +0000 UTC m=+3.953125434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:44.520040 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.520002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:44.520191 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.520145 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:44.520191 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.520164 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:44.520191 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.520175 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:44.520307 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:44.520234 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:45.520216667 +0000 UTC m=+4.053771728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:44.764234 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.764107 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d288d7a_11aa_4135_9732_0205bafc99db.slice/crio-6c2147b00cfaaff6b2173ed69e1ae50b3168b1c1a61dce2d275e4d7d02c04d84 WatchSource:0}: Error finding container 6c2147b00cfaaff6b2173ed69e1ae50b3168b1c1a61dce2d275e4d7d02c04d84: Status 404 returned error can't find the container with id 6c2147b00cfaaff6b2173ed69e1ae50b3168b1c1a61dce2d275e4d7d02c04d84 Jun 09 10:53:44.766559 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.766537 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4067ca_255e_4b08_8261_7d6ed46fda30.slice/crio-78c20d5a1e7a9441472766dc716398405aec8f91b4eac556676b33a41be61e18 WatchSource:0}: Error finding container 78c20d5a1e7a9441472766dc716398405aec8f91b4eac556676b33a41be61e18: Status 404 returned error can't find the container with id 78c20d5a1e7a9441472766dc716398405aec8f91b4eac556676b33a41be61e18 Jun 09 10:53:44.769692 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.769621 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383e5937_c0dd_4aed_854e_0f2d0aeb54f6.slice/crio-fc98a38359306a2e2fc9ac8707d82cd988ff95aebece7915ddddf60d4281a210 WatchSource:0}: Error finding container fc98a38359306a2e2fc9ac8707d82cd988ff95aebece7915ddddf60d4281a210: Status 404 returned error can't find the container with id fc98a38359306a2e2fc9ac8707d82cd988ff95aebece7915ddddf60d4281a210 Jun 09 10:53:44.772861 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.772838 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda078ff6a_217c_4872_8c66_033d64348007.slice/crio-160f7bd76ebc53e72d629a2dd0137467ec160e09e6a1a0567c7423261383839b WatchSource:0}: Error finding container 160f7bd76ebc53e72d629a2dd0137467ec160e09e6a1a0567c7423261383839b: Status 404 returned error can't find the container with id 160f7bd76ebc53e72d629a2dd0137467ec160e09e6a1a0567c7423261383839b Jun 09 10:53:44.773528 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.773505 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901435a6_7ad3_46f7_a6ac_1e1510bbd468.slice/crio-868cdc848f7c731b37cecd2b0a89d052b75f248b6a247e77f631c48f5b7378ce WatchSource:0}: Error finding container 868cdc848f7c731b37cecd2b0a89d052b75f248b6a247e77f631c48f5b7378ce: Status 404 returned error can't find the container with id 868cdc848f7c731b37cecd2b0a89d052b75f248b6a247e77f631c48f5b7378ce Jun 09 10:53:44.774589 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.774443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c68892_e535_4ac8_830c_ebbbdf45b576.slice/crio-d9d404b2b3a8826e6a90ab6c85bf0170e8ec58b617e30609b94fdf46d79d7143 WatchSource:0}: Error finding container d9d404b2b3a8826e6a90ab6c85bf0170e8ec58b617e30609b94fdf46d79d7143: Status 404 returned error can't find the container with id d9d404b2b3a8826e6a90ab6c85bf0170e8ec58b617e30609b94fdf46d79d7143 Jun 09 10:53:44.775751 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.775727 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94cb6419_6a25_4b96_84d1_2a02f31858d9.slice/crio-b764f92964373fc60f3aa1d4b8845da7a68196c5bb6eb26ad7badbfad7d4f13a WatchSource:0}: Error finding container b764f92964373fc60f3aa1d4b8845da7a68196c5bb6eb26ad7badbfad7d4f13a: Status 404 returned error can't find the container with id b764f92964373fc60f3aa1d4b8845da7a68196c5bb6eb26ad7badbfad7d4f13a Jun 09 10:53:44.776389 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.776372 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3990f58_c53e_4831_bf62_a7eca7bc5088.slice/crio-d928562d7259d7bdd95604e3732b14cfc4712bea96672a9ee5f8de7d0e962033 WatchSource:0}: Error finding container d928562d7259d7bdd95604e3732b14cfc4712bea96672a9ee5f8de7d0e962033: Status 404 returned error can't find the container with id d928562d7259d7bdd95604e3732b14cfc4712bea96672a9ee5f8de7d0e962033 Jun 09 10:53:44.798923 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:53:44.798889 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dc867a_3781_47bf_bb81_47ee2896dcee.slice/crio-2ec295ad0656d03051ac6f856ce7923eaf0f41848b4e69b7d29208d9a1b2ecad WatchSource:0}: Error finding container 2ec295ad0656d03051ac6f856ce7923eaf0f41848b4e69b7d29208d9a1b2ecad: Status 404 returned error can't find the container with id 2ec295ad0656d03051ac6f856ce7923eaf0f41848b4e69b7d29208d9a1b2ecad Jun 09 10:53:44.841707 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.841675 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 10:48:43 +0000 UTC" deadline="2028-03-07 17:31:27.914833332 +0000 UTC" Jun 09 10:53:44.841707 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.841703 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15294h37m43.073133021s" Jun 09 10:53:44.884676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.884645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-htd7f" event={"ID":"a3990f58-c53e-4831-bf62-a7eca7bc5088","Type":"ContainerStarted","Data":"d928562d7259d7bdd95604e3732b14cfc4712bea96672a9ee5f8de7d0e962033"} Jun 09 10:53:44.887833 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.887808 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzzd5" event={"ID":"84c68892-e535-4ac8-830c-ebbbdf45b576","Type":"ContainerStarted","Data":"d9d404b2b3a8826e6a90ab6c85bf0170e8ec58b617e30609b94fdf46d79d7143"} Jun 09 10:53:44.889244 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.889221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerStarted","Data":"fc98a38359306a2e2fc9ac8707d82cd988ff95aebece7915ddddf60d4281a210"} Jun 09 10:53:44.890294 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.890264 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2b68l" event={"ID":"a078ff6a-217c-4872-8c66-033d64348007","Type":"ContainerStarted","Data":"160f7bd76ebc53e72d629a2dd0137467ec160e09e6a1a0567c7423261383839b"} Jun 09 10:53:44.891681 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.891663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" event={"ID":"0d288d7a-11aa-4135-9732-0205bafc99db","Type":"ContainerStarted","Data":"6c2147b00cfaaff6b2173ed69e1ae50b3168b1c1a61dce2d275e4d7d02c04d84"} Jun 09 10:53:44.895237 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.895217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5d2p" event={"ID":"a3dc867a-3781-47bf-bb81-47ee2896dcee","Type":"ContainerStarted","Data":"2ec295ad0656d03051ac6f856ce7923eaf0f41848b4e69b7d29208d9a1b2ecad"} Jun 09 10:53:44.900657 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.900633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"b764f92964373fc60f3aa1d4b8845da7a68196c5bb6eb26ad7badbfad7d4f13a"} Jun 09 10:53:44.905760 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.905342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnfkl" event={"ID":"901435a6-7ad3-46f7-a6ac-1e1510bbd468","Type":"ContainerStarted","Data":"868cdc848f7c731b37cecd2b0a89d052b75f248b6a247e77f631c48f5b7378ce"} Jun 09 10:53:44.911986 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:44.911960 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52lmc" event={"ID":"fd4067ca-255e-4b08-8261-7d6ed46fda30","Type":"ContainerStarted","Data":"78c20d5a1e7a9441472766dc716398405aec8f91b4eac556676b33a41be61e18"} Jun 09 10:53:45.426435 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.426154 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:45.426435 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.426221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:45.426435 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.426370 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:45.426435 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.426430 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:47.426412437 +0000 UTC m=+5.959967496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:45.427204 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.426902 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:45.427204 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.426959 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:47.426943178 +0000 UTC m=+5.960498238 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:45.527180 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.527138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:45.527377 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.527325 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:45.527377 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.527350 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:45.527377 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.527363 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:45.527544 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.527425 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:47.527405731 +0000 UTC m=+6.060960803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:45.842676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.842520 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 10:48:43 +0000 UTC" deadline="2027-12-13 10:33:51.737862478 +0000 UTC" Jun 09 10:53:45.842676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.842582 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13247h40m5.895285061s" Jun 09 10:53:45.871597 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.870621 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:45.871597 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.870768 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:45.871597 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.871289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:45.871597 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.871392 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:45.871597 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.871504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:45.871597 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:45.871581 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:45.931871 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.931836 2562 generic.go:356] "Generic (PLEG): container finished" podID="5f3f172483b82b15e1c613215208aaa9" containerID="c769d62433fe3e9f05dbaf77d6783215d1978607beace549595855284e1bcb16" exitCode=0 Jun 09 10:53:45.932069 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.931934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"5f3f172483b82b15e1c613215208aaa9","Type":"ContainerDied","Data":"c769d62433fe3e9f05dbaf77d6783215d1978607beace549595855284e1bcb16"} Jun 09 10:53:45.941721 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:45.941216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" event={"ID":"7952f9e65afac5824d2c2c83b0d6b99f","Type":"ContainerStarted","Data":"5dabb815bc579bc6d88b2cdd09ad55eca8d2015e8ae87b3f7c008f5d25fb7acd"} Jun 09 10:53:46.969326 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:46.969280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" event={"ID":"5f3f172483b82b15e1c613215208aaa9","Type":"ContainerStarted","Data":"16d51022b0c6f012c6a4d9d7419ed672dd33e277a0aa39404b3acd3fa270bdea"} Jun 09 10:53:46.987028 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:46.986965 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-253.ec2.internal" podStartSLOduration=3.986941833 podStartE2EDuration="3.986941833s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:45.975040321 +0000 UTC m=+4.508595421" watchObservedRunningTime="2026-06-09 10:53:46.986941833 +0000 UTC m=+5.520496913" Jun 09 10:53:47.444180 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:47.443885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:47.444180 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:47.444175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:47.444391 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.444029 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:47.444391 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.444380 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:51.444362715 +0000 UTC m=+9.977917790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:47.444650 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.444317 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:47.444650 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.444570 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:51.444553177 +0000 UTC m=+9.978108238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:47.546014 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:47.545350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:47.546014 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.545543 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:47.546014 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.545568 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:47.546014 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.545580 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:47.546014 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.545658 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:51.545640341 +0000 UTC m=+10.079195404 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:47.870450 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:47.870329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:47.870450 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:47.870360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:47.870450 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:47.870335 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:47.870727 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.870459 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:47.870946 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.870918 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:47.871049 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:47.871011 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:49.871406 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:49.870928 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:49.871406 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:49.870929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:49.871406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:49.871064 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:49.871406 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:49.870940 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:49.871406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:49.871132 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:49.871406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:49.871238 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:51.479675 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:51.479630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:51.480123 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:51.479696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:51.480123 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.479807 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:51.480123 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.479818 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:51.480123 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.479889 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:59.479867492 +0000 UTC m=+18.013422561 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:51.480123 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.479905 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:59.479899002 +0000 UTC m=+18.013454059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:51.581101 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:51.581062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:51.581296 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.581278 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:51.581377 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.581302 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:51.581377 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.581314 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:51.581377 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.581375 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:53:59.581357214 +0000 UTC m=+18.114912275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:51.873536 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:51.873462 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:51.873703 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.873574 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:51.873703 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:51.873667 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:51.873816 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.873763 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:51.873816 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:51.873810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:51.873907 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:51.873872 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:53.870137 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:53.870096 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:53.870526 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:53.870249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:53.870697 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:53.870673 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:53.870799 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:53.870775 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:53.870863 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:53.870828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:53.870953 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:53.870905 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:55.870647 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:55.870591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:55.871074 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:55.870614 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:55.871074 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:55.870749 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:55.871074 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:55.870763 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:55.871074 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:55.870880 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:55.871074 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:55.870951 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:57.870897 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:57.870853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:57.871365 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:57.871009 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:57.871365 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:57.871017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:57.871365 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:57.871026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:57.871365 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:57.871122 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:57.871365 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:57.871207 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:53:59.542227 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:59.542186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:59.542742 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:59.542242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:59.542742 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.542362 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:59.542742 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.542366 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:59.542742 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.542429 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:15.542412197 +0000 UTC m=+34.075967255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:53:59.542742 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.542443 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:15.542437316 +0000 UTC m=+34.075992374 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:53:59.643283 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:59.643241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:59.643435 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.643366 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:53:59.643435 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.643381 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:53:59.643435 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.643390 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:59.643550 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.643438 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:15.643424565 +0000 UTC m=+34.176979623 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:53:59.870417 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:59.870339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:53:59.870572 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:59.870339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:53:59.870572 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.870477 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:53:59.870572 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:53:59.870339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:53:59.870755 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.870583 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:53:59.870755 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:53:59.870630 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:01.870884 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:01.870852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:01.871440 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:01.870969 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:01.871440 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:01.871386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:01.871538 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:01.871472 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:01.871538 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:01.871522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:01.871639 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:01.871597 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:03.870712 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:03.870686 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:03.871149 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:03.870686 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:03.871149 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:03.870797 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:03.871149 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:03.870685 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:03.871149 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:03.870902 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:03.871149 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:03.870938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:04.007660 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:04.006363 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2b68l" event={"ID":"a078ff6a-217c-4872-8c66-033d64348007","Type":"ContainerStarted","Data":"0187e59540fd12858d34ee714bac5986eeddbe1e34ca6810ee1b4830fc9418b8"} Jun 09 10:54:04.023294 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:04.021564 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2b68l" podStartSLOduration=7.0454562 podStartE2EDuration="22.021545023s" totalImagesPullingTime="14.976088823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:04.021088891 +0000 UTC m=+22.554643971" watchObservedRunningTime="2026-06-09 10:54:04.021545023 +0000 UTC m=+22.555100105" Jun 09 10:54:04.023294 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:04.022282 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-253.ec2.internal" podStartSLOduration=21.022272022 podStartE2EDuration="21.022272022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:53:46.987757633 +0000 UTC m=+5.521312714" watchObservedRunningTime="2026-06-09 10:54:04.022272022 +0000 UTC m=+22.555827103" Jun 09 10:54:04.621549 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:04.621300 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:04.724019 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:04.723988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:04.981362 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:04.981342 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 10:54:05.012586 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.012555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-52lmc" event={"ID":"fd4067ca-255e-4b08-8261-7d6ed46fda30","Type":"ContainerStarted","Data":"7d004d4c65eb374eb521f8253c09540386dbb85ebe313afda0f70ebfb7903dd7"} Jun 09 10:54:05.014009 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.013982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-htd7f" event={"ID":"a3990f58-c53e-4831-bf62-a7eca7bc5088","Type":"ContainerStarted","Data":"c7b210209fdf63f67df654e5700ce47ed8601de896cef34b0e6c9386b76015b5"} Jun 09 10:54:05.015316 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.015287 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nzzd5" event={"ID":"84c68892-e535-4ac8-830c-ebbbdf45b576","Type":"ContainerStarted","Data":"326f07b019a5c4594b5ca4c5cd58cec04ea1d70c641919e08903045cf1950063"} Jun 09 10:54:05.016686 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.016666 2562 generic.go:356] "Generic (PLEG): container finished" podID="383e5937-c0dd-4aed-854e-0f2d0aeb54f6" containerID="da323806aaf49c20ed2b3212f31f84eee684635da567688e3b29212ba3584d0b" exitCode=0 Jun 09 10:54:05.016768 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.016730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerDied","Data":"da323806aaf49c20ed2b3212f31f84eee684635da567688e3b29212ba3584d0b"} Jun 09 10:54:05.018651 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.018626 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" event={"ID":"0d288d7a-11aa-4135-9732-0205bafc99db","Type":"ContainerStarted","Data":"735f5ab34ee97bc0666045fc7fdec38d2ff63bd6ffb4848da14d73bded362754"} Jun 09 10:54:05.018752 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.018680 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" event={"ID":"0d288d7a-11aa-4135-9732-0205bafc99db","Type":"ContainerStarted","Data":"d967665234f52d186e441a00b0bce3ef0df9569785021e3da3701f6da3763a55"} Jun 09 10:54:05.020096 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.020066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v5d2p" event={"ID":"a3dc867a-3781-47bf-bb81-47ee2896dcee","Type":"ContainerStarted","Data":"cce59fe2d4948e3b22b768679f838a546fd64edbb6f6a57c7b21ceb461ad493e"} Jun 09 10:54:05.022874 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.022854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"10ec5d1aadc02fd430fe54f5a720e628f766c0a19b6cd69d6942fb56344d75d2"} Jun 09 10:54:05.022980 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.022911 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"7741fb7827616db9f3d54d18a82f68331503839e4b642b2b1f448bf9e0753dd6"} Jun 09 10:54:05.022980 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.022954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"cefbe7d807b212a7a34d96271d20093bd836faa49dac017f2f187c8c50a89382"} Jun 09 10:54:05.023086 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.022983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"a07154ff8095d08afedede3756d7a3bd2e80c7b3d0bc04517ef3c1494088564b"} Jun 09 10:54:05.023086 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.023018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"9d34ed34ded952ed6401315de05f5a62f6b95177a943afb4da05149ca8139aca"} Jun 09 10:54:05.023086 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.023052 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"581c1d77363ec95edac325602e5324eddceff7bb69a39d3a4db5ecafe5ef4181"} Jun 09 10:54:05.033296 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.033259 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-52lmc" podStartSLOduration=4.934019441 podStartE2EDuration="24.03324651s" totalImagesPullingTime="19.099227069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:05.032875079 +0000 UTC m=+23.566430142" watchObservedRunningTime="2026-06-09 10:54:05.03324651 +0000 UTC m=+23.566801589" Jun 09 10:54:05.055949 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.055900 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nzzd5" podStartSLOduration=4.927162499 podStartE2EDuration="24.0558859s" totalImagesPullingTime="19.128723401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:05.055692196 +0000 UTC m=+23.589247276" watchObservedRunningTime="2026-06-09 10:54:05.0558859 +0000 UTC m=+23.589440979" Jun 09 10:54:05.083644 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.083581 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v5d2p" podStartSLOduration=4.004843653 podStartE2EDuration="23.083568873s" totalImagesPullingTime="19.07872522s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:05.079280372 +0000 UTC m=+23.612835451" watchObservedRunningTime="2026-06-09 10:54:05.083568873 +0000 UTC m=+23.617123953" Jun 09 10:54:05.125448 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.125416 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:05.127942 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.127909 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-htd7f" podStartSLOduration=4.04337164 podStartE2EDuration="23.12789576s" totalImagesPullingTime="19.08452412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:05.127883173 +0000 UTC m=+23.661438265" watchObservedRunningTime="2026-06-09 10:54:05.12789576 +0000 UTC m=+23.661450840" Jun 09 10:54:05.213583 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.213547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:05.316528 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.316503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:05.870936 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.870900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:05.870936 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.870922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:05.871173 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.870923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:05.871173 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:05.871029 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:05.871173 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:05.871117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:05.871317 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:05.871187 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:05.881953 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.881859 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T10:54:04.98135772Z","UUID":"c4743aee-198c-4322-a5be-5bdf9f70c2ad","Handler":null,"Name":"","Endpoint":""} Jun 09 10:54:05.884898 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.884866 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 10:54:05.885051 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:05.884928 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 10:54:06.025684 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.025655 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:54:06.026333 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.026312 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:54:06.027014 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.026977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qnfkl" event={"ID":"901435a6-7ad3-46f7-a6ac-1e1510bbd468","Type":"ContainerStarted","Data":"25864c5c56aa3168665b4958d9a4cb35a4822404a3cb0ae03a010e01bc5a0287"} Jun 09 10:54:06.029144 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.029118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" event={"ID":"0d288d7a-11aa-4135-9732-0205bafc99db","Type":"ContainerStarted","Data":"ee769df44c90d20f2583fe95838f18cee65d0b6b52b14d885ae48eab9817682e"} Jun 09 10:54:06.030684 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.030655 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:54:06.030790 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.030710 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2b68l" Jun 09 10:54:06.076438 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.076379 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qnfkl" podStartSLOduration=9.101169123 podStartE2EDuration="24.076361988s" totalImagesPullingTime="14.975192865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:06.058260233 +0000 UTC m=+24.591815309" watchObservedRunningTime="2026-06-09 10:54:06.076361988 +0000 UTC m=+24.609917157" Jun 09 10:54:06.096932 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.096873 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-skhzz" podStartSLOduration=3.49980473 podStartE2EDuration="24.096855536s" totalImagesPullingTime="20.597050806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:06.096747326 +0000 UTC m=+24.630302407" watchObservedRunningTime="2026-06-09 10:54:06.096855536 +0000 UTC m=+24.630410637" Jun 09 10:54:06.178949 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.178918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:06.278979 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:06.278903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:07.035320 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:07.035285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"3dc9976ec2c39139a6f4307ba0d4ab3103ca0d9b2f960a752978ddfea9e256a6"} Jun 09 10:54:07.870374 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:07.870341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:07.870563 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:07.870341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:07.870563 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:07.870465 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:07.870563 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:07.870341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:07.870563 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:07.870551 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:07.870790 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:07.870645 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:08.635274 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:08.635237 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:08.734887 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:08.734854 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:09.015763 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.015731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:09.116223 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.116070 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:09.870477 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.870436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:09.870939 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.870436 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:09.870939 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:09.870575 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:09.870939 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.870592 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:09.870939 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:09.870729 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:09.870939 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:09.870811 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:09.907945 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.907906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:09.963874 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:09.963835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:10.046330 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.046288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" event={"ID":"94cb6419-6a25-4b96-84d1-2a02f31858d9","Type":"ContainerStarted","Data":"ded3bf97e2a50103a7ec2b3b42fc7163681b15245b9543f1b37af369c12e59e8"} Jun 09 10:54:10.046533 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.046522 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:54:10.048239 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.048215 2562 generic.go:356] "Generic (PLEG): container finished" podID="383e5937-c0dd-4aed-854e-0f2d0aeb54f6" containerID="3caf95e18c35062d67ff8a877e22984d583de9b13a7c29f7485d44ae33c46869" exitCode=0 Jun 09 10:54:10.048357 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.048246 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerDied","Data":"3caf95e18c35062d67ff8a877e22984d583de9b13a7c29f7485d44ae33c46869"} Jun 09 10:54:10.063522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.063495 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:54:10.073896 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.073853 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" podStartSLOduration=8.951402456 podStartE2EDuration="28.073833491s" totalImagesPullingTime="19.122431035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:10.073740654 +0000 UTC m=+28.607295733" watchObservedRunningTime="2026-06-09 10:54:10.073833491 +0000 UTC m=+28.607388553" Jun 09 10:54:10.173249 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.173158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:10.228541 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:10.228511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:11.051181 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.051035 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 10:54:11.051503 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.051197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:54:11.066491 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.066470 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:54:11.348197 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.348160 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwwrq"] Jun 09 10:54:11.348394 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.348302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:11.348439 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:11.348404 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:11.351163 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.351136 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hz4hn"] Jun 09 10:54:11.351287 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.351251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:11.351394 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:11.351351 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:11.351796 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.351766 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-68ngr"] Jun 09 10:54:11.351896 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:11.351882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:11.352005 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:11.351984 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:12.055484 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.055447 2562 generic.go:356] "Generic (PLEG): container finished" podID="383e5937-c0dd-4aed-854e-0f2d0aeb54f6" containerID="4161e018f21f4f1879cc2fa5cba6fdabd6622cee408c8a89c862cf7056c39841" exitCode=0 Jun 09 10:54:12.056076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.055502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerDied","Data":"4161e018f21f4f1879cc2fa5cba6fdabd6622cee408c8a89c862cf7056c39841"} Jun 09 10:54:12.056076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.055648 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 10:54:12.394676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.394558 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:54:12.870030 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.869991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:12.870030 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.870026 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:12.870209 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:12.870093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:12.870209 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:12.870105 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:12.870209 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:12.870169 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:12.870299 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:12.870229 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:13.528538 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:13.528500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:13.587903 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:13.587871 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:14.062181 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:14.062147 2562 generic.go:356] "Generic (PLEG): container finished" podID="383e5937-c0dd-4aed-854e-0f2d0aeb54f6" containerID="df25dd5d93e094ae5a18e0ced8da2647d897f024a073e30beee221cf59f65f46" exitCode=0 Jun 09 10:54:14.062344 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:14.062243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerDied","Data":"df25dd5d93e094ae5a18e0ced8da2647d897f024a073e30beee221cf59f65f46"} Jun 09 10:54:14.082068 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:14.082020 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" podUID="94cb6419-6a25-4b96-84d1-2a02f31858d9" containerName="ovnkube-controller" probeResult="failure" output="" Jun 09 10:54:14.870689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:14.870585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:14.870689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:14.870620 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:14.870689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:14.870596 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:14.871215 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:14.870743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:54:14.871215 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:14.870852 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hz4hn" podUID="cf98ad87-83fe-4e64-9376-0f2da1317fd7" Jun 09 10:54:14.871215 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:14.870927 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rwwrq" podUID="9e955645-c813-4671-bbbd-d0286e634ff3" Jun 09 10:54:15.570114 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:15.570076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:15.570406 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:15.570132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:15.570406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.570203 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 10:54:15.570406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.570248 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:54:15.570406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.570277 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret podName:9e955645-c813-4671-bbbd-d0286e634ff3 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:47.570256446 +0000 UTC m=+66.103811522 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret") pod "global-pull-secret-syncer-rwwrq" (UID: "9e955645-c813-4671-bbbd-d0286e634ff3") : object "kube-system"/"original-pull-secret" not registered Jun 09 10:54:15.570406 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.570304 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:47.570288234 +0000 UTC m=+66.103843295 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 10:54:15.670510 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:15.670468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:15.670722 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.670654 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 10:54:15.670722 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.670679 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 10:54:15.670722 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.670689 2562 projected.go:196] Error preparing data for projected volume kube-api-access-fjcv5 for pod openshift-network-diagnostics/network-check-target-hz4hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:54:15.670895 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:15.670749 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5 podName:cf98ad87-83fe-4e64-9376-0f2da1317fd7 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:47.670728299 +0000 UTC m=+66.204283360 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fjcv5" (UniqueName: "kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5") pod "network-check-target-hz4hn" (UID: "cf98ad87-83fe-4e64-9376-0f2da1317fd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 10:54:16.789388 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.789196 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-253.ec2.internal" event="NodeReady" Jun 09 10:54:16.789827 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.789497 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 10:54:16.841873 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.840153 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9vltf"] Jun 09 10:54:16.863625 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.863569 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7mk6z"] Jun 09 10:54:16.863806 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.863717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:16.868367 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.868339 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 10:54:16.868490 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.868453 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k9trm\"" Jun 09 10:54:16.868490 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.868466 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 10:54:16.877662 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.877638 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vltf"] Jun 09 10:54:16.877785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.877680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7mk6z"] Jun 09 10:54:16.877785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.877733 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:16.877785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.877749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:16.877785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.877734 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:16.877952 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.877826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:16.882418 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.882394 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 10:54:16.882531 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.882461 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vng8v\"" Jun 09 10:54:16.882531 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.882475 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 10:54:16.882786 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.882766 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 10:54:16.882911 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.882809 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 10:54:16.882911 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.882845 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 10:54:16.883498 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.883468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 10:54:16.883651 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.883562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 10:54:16.883854 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.883832 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfn6d\"" Jun 09 10:54:16.883987 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.883857 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ghcvx\"" Jun 09 10:54:16.982673 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.982643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af36d076-fc63-41fc-9e65-53b0254bb0b4-config-volume\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:16.982847 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.982688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af36d076-fc63-41fc-9e65-53b0254bb0b4-tmp-dir\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:16.982847 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.982779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0-cert\") pod \"ingress-canary-7mk6z\" (UID: \"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0\") " pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:16.982847 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.982816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qdn\" (UniqueName: \"kubernetes.io/projected/f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0-kube-api-access-46qdn\") pod \"ingress-canary-7mk6z\" (UID: \"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0\") " pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:16.982993 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.982853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:16.982993 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.982926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzd9b\" (UniqueName: \"kubernetes.io/projected/af36d076-fc63-41fc-9e65-53b0254bb0b4-kube-api-access-rzd9b\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:16.986119 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:16.986084 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:17.083562 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzd9b\" (UniqueName: \"kubernetes.io/projected/af36d076-fc63-41fc-9e65-53b0254bb0b4-kube-api-access-rzd9b\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.083562 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af36d076-fc63-41fc-9e65-53b0254bb0b4-config-volume\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.083809 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af36d076-fc63-41fc-9e65-53b0254bb0b4-tmp-dir\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.083809 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0-cert\") pod \"ingress-canary-7mk6z\" (UID: \"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0\") " pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:17.083809 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qdn\" (UniqueName: \"kubernetes.io/projected/f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0-kube-api-access-46qdn\") pod \"ingress-canary-7mk6z\" (UID: \"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0\") " pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:17.083809 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.083809 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:17.083805 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:17.084029 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:17.083879 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:17.583843567 +0000 UTC m=+36.117398629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:17.084029 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.083995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af36d076-fc63-41fc-9e65-53b0254bb0b4-tmp-dir\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.084395 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.084366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af36d076-fc63-41fc-9e65-53b0254bb0b4-config-volume\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.086705 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.086679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:17.088907 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.088885 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0-cert\") pod \"ingress-canary-7mk6z\" (UID: \"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0\") " pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:17.095676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.095656 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qdn\" (UniqueName: \"kubernetes.io/projected/f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0-kube-api-access-46qdn\") pod \"ingress-canary-7mk6z\" (UID: \"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0\") " pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:17.096983 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.096962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzd9b\" (UniqueName: \"kubernetes.io/projected/af36d076-fc63-41fc-9e65-53b0254bb0b4-kube-api-access-rzd9b\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.202136 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.202089 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7mk6z" Jun 09 10:54:17.587279 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:17.587241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:17.587479 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:17.587374 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:17.587479 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:17.587459 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:18.587434491 +0000 UTC m=+37.120989549 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:18.239502 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:18.239469 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7mk6z"] Jun 09 10:54:18.327948 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:54:18.327895 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c2212d_1617_4d3e_8a99_ce0ce1ed74a0.slice/crio-194c771ddb1c1014215ce91f56afcab7f511884f3fbdceaaa35c506247ea6026 WatchSource:0}: Error finding container 194c771ddb1c1014215ce91f56afcab7f511884f3fbdceaaa35c506247ea6026: Status 404 returned error can't find the container with id 194c771ddb1c1014215ce91f56afcab7f511884f3fbdceaaa35c506247ea6026 Jun 09 10:54:18.595863 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:18.595827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:18.595993 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:18.595969 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:18.596051 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:18.596039 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:20.596020045 +0000 UTC m=+39.129575120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:19.075209 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:19.075168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7mk6z" event={"ID":"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0","Type":"ContainerStarted","Data":"194c771ddb1c1014215ce91f56afcab7f511884f3fbdceaaa35c506247ea6026"} Jun 09 10:54:19.078505 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:19.078470 2562 generic.go:356] "Generic (PLEG): container finished" podID="383e5937-c0dd-4aed-854e-0f2d0aeb54f6" containerID="9f6104380198850fdc07799f05f594a4ea368fd2094053133c35616be3bde023" exitCode=0 Jun 09 10:54:19.078655 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:19.078523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerDied","Data":"9f6104380198850fdc07799f05f594a4ea368fd2094053133c35616be3bde023"} Jun 09 10:54:20.085177 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:20.085132 2562 generic.go:356] "Generic (PLEG): container finished" podID="383e5937-c0dd-4aed-854e-0f2d0aeb54f6" containerID="09532226543a78e1cbee780749f8d68c89c988c2de2039ba54a2d45d39d0bdbf" exitCode=0 Jun 09 10:54:20.085622 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:20.085210 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerDied","Data":"09532226543a78e1cbee780749f8d68c89c988c2de2039ba54a2d45d39d0bdbf"} Jun 09 10:54:20.611372 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:20.611336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:20.611554 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:20.611491 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:20.611594 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:20.611560 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:24.61154434 +0000 UTC m=+43.145099398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:21.088858 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.088825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7mk6z" event={"ID":"f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0","Type":"ContainerStarted","Data":"15bd9f1b09c23f4b685b98a42bc2dfcff18291733fcccecfe669a35741bce20a"} Jun 09 10:54:21.092018 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.091990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v9snq" event={"ID":"383e5937-c0dd-4aed-854e-0f2d0aeb54f6","Type":"ContainerStarted","Data":"fab0d1223228b68c1d994a43daab6a9b768eaca429c6affba5f26871d41844f2"} Jun 09 10:54:21.106418 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.106355 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7mk6z" podStartSLOduration=3.2422156109999998 podStartE2EDuration="5.10633449s" totalImagesPullingTime="1.864118879s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:21.105641016 +0000 UTC m=+39.639196093" watchObservedRunningTime="2026-06-09 10:54:21.10633449 +0000 UTC m=+39.639889572" Jun 09 10:54:21.132233 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.132179 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v9snq" podStartSLOduration=9.357265946 podStartE2EDuration="39.132160947s" totalImagesPullingTime="29.774895001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:21.131419923 +0000 UTC m=+39.664974994" watchObservedRunningTime="2026-06-09 10:54:21.132160947 +0000 UTC m=+39.665716029" Jun 09 10:54:21.152372 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.152311 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:21.259126 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.259073 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:21.314745 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:21.314717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:24.638313 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:24.638276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:24.638755 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:24.638386 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:24.638755 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:24.638450 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:32.638436982 +0000 UTC m=+51.171992041 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:29.996435 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:29.996400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:30.053803 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:30.053773 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:31.608258 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:31.608221 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:31.662834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:31.662806 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:32.692812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:32.692770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:32.693286 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:32.692890 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:32.693286 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:32.692955 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:54:48.692940782 +0000 UTC m=+67.226495840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:37.176246 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.176202 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx"] Jun 09 10:54:37.211056 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.211024 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx"] Jun 09 10:54:37.211224 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.211127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.214050 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.214026 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 10:54:37.214275 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.214260 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 10:54:37.215363 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.215344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 10:54:37.215417 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.215382 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 10:54:37.328652 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.328586 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdcq5\" (UniqueName: \"kubernetes.io/projected/af3ebfd5-138f-4725-875f-c3d8a4d42196-kube-api-access-kdcq5\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.328652 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.328650 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/af3ebfd5-138f-4725-875f-c3d8a4d42196-klusterlet-config\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.328859 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.328718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af3ebfd5-138f-4725-875f-c3d8a4d42196-tmp\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.430068 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.429971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdcq5\" (UniqueName: \"kubernetes.io/projected/af3ebfd5-138f-4725-875f-c3d8a4d42196-kube-api-access-kdcq5\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.430068 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.430014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/af3ebfd5-138f-4725-875f-c3d8a4d42196-klusterlet-config\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.430068 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.430037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af3ebfd5-138f-4725-875f-c3d8a4d42196-tmp\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.430392 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.430376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af3ebfd5-138f-4725-875f-c3d8a4d42196-tmp\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.434119 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.434076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/af3ebfd5-138f-4725-875f-c3d8a4d42196-klusterlet-config\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.439046 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.439018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdcq5\" (UniqueName: \"kubernetes.io/projected/af3ebfd5-138f-4725-875f-c3d8a4d42196-kube-api-access-kdcq5\") pod \"klusterlet-addon-workmgr-565879fc6c-shffx\" (UID: \"af3ebfd5-138f-4725-875f-c3d8a4d42196\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.520590 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.520534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:37.675813 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:37.675776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx"] Jun 09 10:54:37.679959 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:54:37.679922 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf3ebfd5_138f_4725_875f_c3d8a4d42196.slice/crio-d2058955c1772ca41d69e2a443659161abdf74fd5e4240b52de4c880b32db997 WatchSource:0}: Error finding container d2058955c1772ca41d69e2a443659161abdf74fd5e4240b52de4c880b32db997: Status 404 returned error can't find the container with id d2058955c1772ca41d69e2a443659161abdf74fd5e4240b52de4c880b32db997 Jun 09 10:54:38.137158 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:38.137117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" event={"ID":"af3ebfd5-138f-4725-875f-c3d8a4d42196","Type":"ContainerStarted","Data":"d2058955c1772ca41d69e2a443659161abdf74fd5e4240b52de4c880b32db997"} Jun 09 10:54:42.150052 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:42.150006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" event={"ID":"af3ebfd5-138f-4725-875f-c3d8a4d42196","Type":"ContainerStarted","Data":"44c42e8c570d9992b0483787173c5bdc7e06ddedff0215dc6e2905bd2e89bc37"} Jun 09 10:54:42.150516 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:42.150215 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:42.151840 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:42.151798 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:54:42.166904 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:42.166860 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" podStartSLOduration=0.930350267 podStartE2EDuration="5.166845557s" totalImagesPullingTime="4.23649529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:54:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:42.166185445 +0000 UTC m=+60.699740527" watchObservedRunningTime="2026-06-09 10:54:42.166845557 +0000 UTC m=+60.700400634" Jun 09 10:54:44.072860 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:44.072831 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qf8zc" Jun 09 10:54:44.194902 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:44.194868 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:44.295996 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:44.295958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:54:47.599208 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.599146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:47.599208 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.599218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:54:47.602248 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.602222 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 10:54:47.602310 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.602269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 10:54:47.609648 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:47.609625 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 10:54:47.609721 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:47.609713 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:55:51.60969061 +0000 UTC m=+130.143245667 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : secret "metrics-daemon-secret" not found Jun 09 10:54:47.611967 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.611943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9e955645-c813-4671-bbbd-d0286e634ff3-original-pull-secret\") pod \"global-pull-secret-syncer-rwwrq\" (UID: \"9e955645-c813-4671-bbbd-d0286e634ff3\") " pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:47.699908 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.699855 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:47.703178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.703155 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 10:54:47.714381 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.714349 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 10:54:47.724734 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.724703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjcv5\" (UniqueName: \"kubernetes.io/projected/cf98ad87-83fe-4e64-9376-0f2da1317fd7-kube-api-access-fjcv5\") pod \"network-check-target-hz4hn\" (UID: \"cf98ad87-83fe-4e64-9376-0f2da1317fd7\") " pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:47.792138 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.792107 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vng8v\"" Jun 09 10:54:47.795676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.795655 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rwwrq" Jun 09 10:54:47.799472 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.799454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:47.946672 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.946633 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rwwrq"] Jun 09 10:54:47.950736 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:54:47.950706 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e955645_c813_4671_bbbd_d0286e634ff3.slice/crio-28bd5f94c7e25174803091150517c4d3f63933148a59b8af5deed3b89fda36a7 WatchSource:0}: Error finding container 28bd5f94c7e25174803091150517c4d3f63933148a59b8af5deed3b89fda36a7: Status 404 returned error can't find the container with id 28bd5f94c7e25174803091150517c4d3f63933148a59b8af5deed3b89fda36a7 Jun 09 10:54:47.963629 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:47.963571 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hz4hn"] Jun 09 10:54:47.966721 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:54:47.966696 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf98ad87_83fe_4e64_9376_0f2da1317fd7.slice/crio-8d87ee75de8723a0216ad10fc2771ecbadcb5f4f8ec0795527fdb20acd2fe25b WatchSource:0}: Error finding container 8d87ee75de8723a0216ad10fc2771ecbadcb5f4f8ec0795527fdb20acd2fe25b: Status 404 returned error can't find the container with id 8d87ee75de8723a0216ad10fc2771ecbadcb5f4f8ec0795527fdb20acd2fe25b Jun 09 10:54:48.166630 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:48.166524 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hz4hn" event={"ID":"cf98ad87-83fe-4e64-9376-0f2da1317fd7","Type":"ContainerStarted","Data":"8d87ee75de8723a0216ad10fc2771ecbadcb5f4f8ec0795527fdb20acd2fe25b"} Jun 09 10:54:48.167531 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:48.167508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwwrq" event={"ID":"9e955645-c813-4671-bbbd-d0286e634ff3","Type":"ContainerStarted","Data":"28bd5f94c7e25174803091150517c4d3f63933148a59b8af5deed3b89fda36a7"} Jun 09 10:54:48.708946 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:48.708903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:54:48.709386 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:48.709084 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:54:48.709386 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:54:48.709165 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:55:20.709142749 +0000 UTC m=+99.242697815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:54:53.182059 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:53.182015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hz4hn" event={"ID":"cf98ad87-83fe-4e64-9376-0f2da1317fd7","Type":"ContainerStarted","Data":"7b83f1d7c9d762144b9bf5897891112f0cab61f7cbc057e46a4f1a2b119e8e44"} Jun 09 10:54:53.182527 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:53.182118 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:54:53.183565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:53.183541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rwwrq" event={"ID":"9e955645-c813-4671-bbbd-d0286e634ff3","Type":"ContainerStarted","Data":"1db96375d6d234c8766ed11b382dd5d5b4239906c536b9c328e469ad5679480d"} Jun 09 10:54:53.198668 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:53.198623 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hz4hn" podStartSLOduration=67.970361078 podStartE2EDuration="1m12.198592219s" totalImagesPullingTime="4.228231141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:53.19841472 +0000 UTC m=+71.731969800" watchObservedRunningTime="2026-06-09 10:54:53.198592219 +0000 UTC m=+71.732147277" Jun 09 10:54:53.213975 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:54:53.213924 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rwwrq" podStartSLOduration=66.964244418 podStartE2EDuration="1m11.213911946s" totalImagesPullingTime="4.249667528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:54:53.213415425 +0000 UTC m=+71.746970506" watchObservedRunningTime="2026-06-09 10:54:53.213911946 +0000 UTC m=+71.747467025" Jun 09 10:55:20.727179 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:55:20.727143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:55:20.727549 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:55:20.727305 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:55:20.727549 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:55:20.727385 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:56:24.727368214 +0000 UTC m=+163.260923272 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:55:24.188421 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:55:24.188384 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hz4hn" Jun 09 10:55:51.653281 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:55:51.653219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:55:51.653874 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:55:51.653374 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 10:55:51.653874 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:55:51.653455 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs podName:fbe71c5d-3b91-4888-bbfe-f207c6f8bf54 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:53.653430481 +0000 UTC m=+252.186985539 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs") pod "network-metrics-daemon-68ngr" (UID: "fbe71c5d-3b91-4888-bbfe-f207c6f8bf54") : secret "metrics-daemon-secret" not found Jun 09 10:56:19.875056 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:56:19.875020 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9vltf" podUID="af36d076-fc63-41fc-9e65-53b0254bb0b4" Jun 09 10:56:19.907218 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:56:19.907177 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-68ngr" podUID="fbe71c5d-3b91-4888-bbfe-f207c6f8bf54" Jun 09 10:56:20.395887 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:20.395431 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vltf" Jun 09 10:56:24.778634 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:24.778523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:56:24.779104 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:56:24.778697 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 10:56:24.779104 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:56:24.778774 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls podName:af36d076-fc63-41fc-9e65-53b0254bb0b4 nodeName:}" failed. No retries permitted until 2026-06-09 10:58:26.778756565 +0000 UTC m=+285.312311625 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls") pod "dns-default-9vltf" (UID: "af36d076-fc63-41fc-9e65-53b0254bb0b4") : secret "dns-default-metrics-tls" not found Jun 09 10:56:32.870203 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:32.870163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:56:36.663869 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:36.663836 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:56:42.150713 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:42.150665 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" podUID="af3ebfd5-138f-4725-875f-c3d8a4d42196" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused" Jun 09 10:56:42.450181 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:42.450095 2562 generic.go:356] "Generic (PLEG): container finished" podID="af3ebfd5-138f-4725-875f-c3d8a4d42196" containerID="44c42e8c570d9992b0483787173c5bdc7e06ddedff0215dc6e2905bd2e89bc37" exitCode=1 Jun 09 10:56:42.450181 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:42.450135 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" event={"ID":"af3ebfd5-138f-4725-875f-c3d8a4d42196","Type":"ContainerDied","Data":"44c42e8c570d9992b0483787173c5bdc7e06ddedff0215dc6e2905bd2e89bc37"} Jun 09 10:56:42.450473 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:42.450458 2562 scope.go:117] "RemoveContainer" containerID="44c42e8c570d9992b0483787173c5bdc7e06ddedff0215dc6e2905bd2e89bc37" Jun 09 10:56:43.454386 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:43.454353 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" event={"ID":"af3ebfd5-138f-4725-875f-c3d8a4d42196","Type":"ContainerStarted","Data":"e97008f244aa32e2b58e77e9839ae0a5e0228f6b153c05690802e70816093e5e"} Jun 09 10:56:43.454800 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:43.454642 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:56:43.455280 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:56:43.455250 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-565879fc6c-shffx" Jun 09 10:57:03.675854 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.675817 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k"] Jun 09 10:57:03.678683 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.678666 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" Jun 09 10:57:03.682967 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.682937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.683337 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.683305 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-754456dd49-6xrfv"] Jun 09 10:57:03.683449 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.683399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.683536 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.683499 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9chpf\"" Jun 09 10:57:03.686373 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.686354 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.689178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.689154 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 09 10:57:03.689388 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.689365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 09 10:57:03.690098 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.690068 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 09 10:57:03.690200 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.690105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-q87j2\"" Jun 09 10:57:03.690200 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.690141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 10:57:03.690200 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.690187 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 09 10:57:03.690354 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.690227 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 10:57:03.696097 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.696074 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k"] Jun 09 10:57:03.701847 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.701819 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-754456dd49-6xrfv"] Jun 09 10:57:03.752587 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.752544 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-default-certificate\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.752785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.752619 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwnp\" (UniqueName: \"kubernetes.io/projected/0171e4f1-6379-4c6c-b955-ba14b90ec878-kube-api-access-sqwnp\") pod \"volume-data-source-validator-78dd696465-hvn5k\" (UID: \"0171e4f1-6379-4c6c-b955-ba14b90ec878\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" Jun 09 10:57:03.752785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.752645 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.752785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.752676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.752785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.752750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsl6l\" (UniqueName: \"kubernetes.io/projected/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-kube-api-access-xsl6l\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.752785 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.752774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-stats-auth\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.775222 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.775185 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8695cd6dc5-58dmq"] Jun 09 10:57:03.778189 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.778172 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.780816 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.780789 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 10:57:03.780962 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.780946 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vv4rr\"" Jun 09 10:57:03.781194 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.781171 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 10:57:03.781364 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.781345 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 10:57:03.786787 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.786764 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 10:57:03.797747 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.797719 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8695cd6dc5-58dmq"] Jun 09 10:57:03.853660 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-default-certificate\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.853845 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-certificates\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.853845 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwnp\" (UniqueName: \"kubernetes.io/projected/0171e4f1-6379-4c6c-b955-ba14b90ec878-kube-api-access-sqwnp\") pod \"volume-data-source-validator-78dd696465-hvn5k\" (UID: \"0171e4f1-6379-4c6c-b955-ba14b90ec878\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" Jun 09 10:57:03.853845 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.853845 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93e6c9e8-1561-454b-9147-62d1ca81032e-ca-trust-extracted\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.853845 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-trusted-ca\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.854043 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:03.853863 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:04.353845233 +0000 UTC m=+202.887400291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : configmap references non-existent config key: service-ca.crt Jun 09 10:57:03.854043 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.854043 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.853990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-image-registry-private-configuration\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.854043 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:03.854015 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 10:57:03.854043 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.854035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfjwb\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-kube-api-access-hfjwb\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.854292 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:03.854054 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:04.354042487 +0000 UTC m=+202.887597547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : secret "router-metrics-certs-default" not found Jun 09 10:57:03.854292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.854083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-installation-pull-secrets\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.854292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.854115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.854292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.854132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-bound-sa-token\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.854292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.854194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsl6l\" (UniqueName: \"kubernetes.io/projected/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-kube-api-access-xsl6l\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.854292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.854224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-stats-auth\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.856434 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.856402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-default-certificate\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.856687 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.856669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-stats-auth\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.867417 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.867390 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsl6l\" (UniqueName: \"kubernetes.io/projected/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-kube-api-access-xsl6l\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:03.867588 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.867560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwnp\" (UniqueName: \"kubernetes.io/projected/0171e4f1-6379-4c6c-b955-ba14b90ec878-kube-api-access-sqwnp\") pod \"volume-data-source-validator-78dd696465-hvn5k\" (UID: \"0171e4f1-6379-4c6c-b955-ba14b90ec878\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" Jun 09 10:57:03.874264 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.874239 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-nz968"] Jun 09 10:57:03.877301 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.877285 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:03.880038 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.880018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 10:57:03.880151 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.880076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 10:57:03.880203 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.880170 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z4phn\"" Jun 09 10:57:03.883980 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.883959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-nz968"] Jun 09 10:57:03.945135 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.945049 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:03.955101 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955190 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-bound-sa-token\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955190 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-certificates\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955190 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:03.955335 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955200 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93e6c9e8-1561-454b-9147-62d1ca81032e-ca-trust-extracted\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955335 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-trusted-ca\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955335 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:03.955237 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:57:03.955335 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/184f2c3c-5894-4520-a346-3645bb9470c6-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:03.955335 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:03.955252 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8695cd6dc5-58dmq: secret "image-registry-tls" not found Jun 09 10:57:03.955565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-image-registry-private-configuration\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955565 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:03.955372 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls podName:93e6c9e8-1561-454b-9147-62d1ca81032e nodeName:}" failed. No retries permitted until 2026-06-09 10:57:04.455333483 +0000 UTC m=+202.988888550 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls") pod "image-registry-8695cd6dc5-58dmq" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e") : secret "image-registry-tls" not found Jun 09 10:57:03.955565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfjwb\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-kube-api-access-hfjwb\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955565 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-installation-pull-secrets\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955808 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93e6c9e8-1561-454b-9147-62d1ca81032e-ca-trust-extracted\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.955864 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.955852 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-certificates\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.956286 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.956269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-trusted-ca\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.957868 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.957845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-image-registry-private-configuration\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.958003 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.957981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-installation-pull-secrets\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.964537 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.964505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-bound-sa-token\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.965056 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.965033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfjwb\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-kube-api-access-hfjwb\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:03.988095 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:03.988062 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" Jun 09 10:57:04.044084 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.044042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:04.056210 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.056175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:04.056379 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.056224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/184f2c3c-5894-4520-a346-3645bb9470c6-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:04.056379 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.056330 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 10:57:04.056492 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.056413 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert podName:184f2c3c-5894-4520-a346-3645bb9470c6 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:04.55639418 +0000 UTC m=+203.089949247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nz968" (UID: "184f2c3c-5894-4520-a346-3645bb9470c6") : secret "networking-console-plugin-cert" not found Jun 09 10:57:04.056832 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.056810 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/184f2c3c-5894-4520-a346-3645bb9470c6-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:04.116031 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.116000 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k"] Jun 09 10:57:04.119102 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:04.119076 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0171e4f1_6379_4c6c_b955_ba14b90ec878.slice/crio-8efe3a4b49d28017c394d69302475aa7bfee3339e8b93faec330d1dd3206fe82 WatchSource:0}: Error finding container 8efe3a4b49d28017c394d69302475aa7bfee3339e8b93faec330d1dd3206fe82: Status 404 returned error can't find the container with id 8efe3a4b49d28017c394d69302475aa7bfee3339e8b93faec330d1dd3206fe82 Jun 09 10:57:04.359706 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.359670 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:04.359877 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.359771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:04.359877 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.359833 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 10:57:04.359952 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.359882 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:05.359868388 +0000 UTC m=+203.893423446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : configmap references non-existent config key: service-ca.crt Jun 09 10:57:04.359952 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.359896 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:05.359890386 +0000 UTC m=+203.893445443 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : secret "router-metrics-certs-default" not found Jun 09 10:57:04.460969 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.460936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:04.461131 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.461091 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:57:04.461131 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.461112 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8695cd6dc5-58dmq: secret "image-registry-tls" not found Jun 09 10:57:04.461199 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.461171 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls podName:93e6c9e8-1561-454b-9147-62d1ca81032e nodeName:}" failed. No retries permitted until 2026-06-09 10:57:05.46115282 +0000 UTC m=+203.994707901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls") pod "image-registry-8695cd6dc5-58dmq" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e") : secret "image-registry-tls" not found Jun 09 10:57:04.507444 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.507415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" event={"ID":"0171e4f1-6379-4c6c-b955-ba14b90ec878","Type":"ContainerStarted","Data":"8efe3a4b49d28017c394d69302475aa7bfee3339e8b93faec330d1dd3206fe82"} Jun 09 10:57:04.562087 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:04.562053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:04.562266 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.562241 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 10:57:04.562342 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:04.562329 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert podName:184f2c3c-5894-4520-a346-3645bb9470c6 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:05.562305955 +0000 UTC m=+204.095861018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nz968" (UID: "184f2c3c-5894-4520-a346-3645bb9470c6") : secret "networking-console-plugin-cert" not found Jun 09 10:57:05.368280 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.368171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:05.368280 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.368227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:05.368846 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.368382 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 10:57:05.368846 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.368388 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:07.368364383 +0000 UTC m=+205.901919444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : configmap references non-existent config key: service-ca.crt Jun 09 10:57:05.368846 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.368426 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:07.368412271 +0000 UTC m=+205.901967329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : secret "router-metrics-certs-default" not found Jun 09 10:57:05.469378 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.469338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:05.469535 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.469486 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:57:05.469535 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.469507 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8695cd6dc5-58dmq: secret "image-registry-tls" not found Jun 09 10:57:05.469671 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.469564 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls podName:93e6c9e8-1561-454b-9147-62d1ca81032e nodeName:}" failed. No retries permitted until 2026-06-09 10:57:07.46954724 +0000 UTC m=+206.003102297 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls") pod "image-registry-8695cd6dc5-58dmq" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e") : secret "image-registry-tls" not found Jun 09 10:57:05.512041 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.512003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" event={"ID":"0171e4f1-6379-4c6c-b955-ba14b90ec878","Type":"ContainerStarted","Data":"d63775bbd6e01623c4d762930bc8826f420cc7cfa6c07133ca840ead5b7013ec"} Jun 09 10:57:05.528001 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.527941 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-hvn5k" podStartSLOduration=1.545739841 podStartE2EDuration="2.527922207s" totalImagesPullingTime="982.182366ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:05.527679232 +0000 UTC m=+204.061234312" watchObservedRunningTime="2026-06-09 10:57:05.527922207 +0000 UTC m=+204.061477289" Jun 09 10:57:05.570044 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.570016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:05.570204 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.570183 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 10:57:05.570260 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:05.570250 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert podName:184f2c3c-5894-4520-a346-3645bb9470c6 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:07.570235421 +0000 UTC m=+206.103790479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nz968" (UID: "184f2c3c-5894-4520-a346-3645bb9470c6") : secret "networking-console-plugin-cert" not found Jun 09 10:57:05.645365 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.645253 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:05.706340 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:05.706308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:07.385346 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:07.385300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:07.385823 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:07.385405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:07.385823 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.385473 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 10:57:07.385823 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.385518 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:11.385503719 +0000 UTC m=+209.919058777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : configmap references non-existent config key: service-ca.crt Jun 09 10:57:07.385823 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.385532 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:11.385526568 +0000 UTC m=+209.919081626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : secret "router-metrics-certs-default" not found Jun 09 10:57:07.486413 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:07.486357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:07.486530 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.486503 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:57:07.486530 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.486523 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8695cd6dc5-58dmq: secret "image-registry-tls" not found Jun 09 10:57:07.486633 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.486572 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls podName:93e6c9e8-1561-454b-9147-62d1ca81032e nodeName:}" failed. No retries permitted until 2026-06-09 10:57:11.486558123 +0000 UTC m=+210.020113181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls") pod "image-registry-8695cd6dc5-58dmq" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e") : secret "image-registry-tls" not found Jun 09 10:57:07.587053 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:07.587021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:07.587236 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.587173 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 10:57:07.587282 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:07.587255 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert podName:184f2c3c-5894-4520-a346-3645bb9470c6 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:11.587237024 +0000 UTC m=+210.120792082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nz968" (UID: "184f2c3c-5894-4520-a346-3645bb9470c6") : secret "networking-console-plugin-cert" not found Jun 09 10:57:08.908270 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:08.908234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:09.270886 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:09.270856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:09.341327 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:09.341287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:09.398332 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:09.398291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:09.499514 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:09.499474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:09.900586 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:09.900527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:09.964681 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:09.964644 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:10.137875 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:10.137842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:10.236964 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:10.236922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:11.016874 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.016848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5d2p_a3dc867a-3781-47bf-bb81-47ee2896dcee/dns-node-resolver/0.log" Jun 09 10:57:11.418272 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.418180 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:11.418428 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.418311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:11.418428 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.418334 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 10:57:11.418428 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.418415 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:19.418398441 +0000 UTC m=+217.951953501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : secret "router-metrics-certs-default" not found Jun 09 10:57:11.418541 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.418432 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:19.418424814 +0000 UTC m=+217.951979872 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : configmap references non-existent config key: service-ca.crt Jun 09 10:57:11.421866 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.421834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:11.519284 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.519252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:11.519444 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.519421 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 10:57:11.519523 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.519448 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8695cd6dc5-58dmq: secret "image-registry-tls" not found Jun 09 10:57:11.519523 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.519518 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls podName:93e6c9e8-1561-454b-9147-62d1ca81032e nodeName:}" failed. No retries permitted until 2026-06-09 10:57:19.519496873 +0000 UTC m=+218.053051948 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls") pod "image-registry-8695cd6dc5-58dmq" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e") : secret "image-registry-tls" not found Jun 09 10:57:11.619658 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.619596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:11.619837 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.619716 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 10:57:11.619837 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.619754 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52lmc_fd4067ca-255e-4b08-8261-7d6ed46fda30/node-ca/0.log" Jun 09 10:57:11.619837 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:11.619775 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert podName:184f2c3c-5894-4520-a346-3645bb9470c6 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:19.619759994 +0000 UTC m=+218.153315051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nz968" (UID: "184f2c3c-5894-4520-a346-3645bb9470c6") : secret "networking-console-plugin-cert" not found Jun 09 10:57:11.731182 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.731150 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4rvxg"] Jun 09 10:57:11.734125 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.734109 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.736815 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.736793 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 10:57:11.738243 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.738216 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 10:57:11.738339 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.738241 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-9tc7m\"" Jun 09 10:57:11.738339 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.738268 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 10:57:11.738339 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.738216 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 10:57:11.742379 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.742356 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4rvxg"] Jun 09 10:57:11.773596 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.773564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:11.820907 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.820873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jc7jn\" (UniqueName: \"kubernetes.io/projected/6d34e60f-da74-43c9-8009-9597c13ec4d2-kube-api-access-jc7jn\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.820907 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.820911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d34e60f-da74-43c9-8009-9597c13ec4d2-signing-cabundle\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.821146 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.820932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d34e60f-da74-43c9-8009-9597c13ec4d2-signing-key\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.835135 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.835104 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:11.922326 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.922289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jc7jn\" (UniqueName: \"kubernetes.io/projected/6d34e60f-da74-43c9-8009-9597c13ec4d2-kube-api-access-jc7jn\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.922326 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.922334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d34e60f-da74-43c9-8009-9597c13ec4d2-signing-cabundle\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.922591 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.922359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d34e60f-da74-43c9-8009-9597c13ec4d2-signing-key\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.923047 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.923027 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/6d34e60f-da74-43c9-8009-9597c13ec4d2-signing-cabundle\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.924992 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.924968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/6d34e60f-da74-43c9-8009-9597c13ec4d2-signing-key\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:11.931541 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:11.931510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jc7jn\" (UniqueName: \"kubernetes.io/projected/6d34e60f-da74-43c9-8009-9597c13ec4d2-kube-api-access-jc7jn\") pod \"service-ca-7d74d578b8-4rvxg\" (UID: \"6d34e60f-da74-43c9-8009-9597c13ec4d2\") " pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:12.044035 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:12.043924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" Jun 09 10:57:12.181872 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:12.181836 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4rvxg"] Jun 09 10:57:12.185198 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:12.185169 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d34e60f_da74_43c9_8009_9597c13ec4d2.slice/crio-68093788481ea97181fd1d65bfbc45fb59277be5ee854a47f48016cf931b2720 WatchSource:0}: Error finding container 68093788481ea97181fd1d65bfbc45fb59277be5ee854a47f48016cf931b2720: Status 404 returned error can't find the container with id 68093788481ea97181fd1d65bfbc45fb59277be5ee854a47f48016cf931b2720 Jun 09 10:57:12.418420 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:12.418340 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7mk6z_f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0/serve-healthcheck-canary/0.log" Jun 09 10:57:12.534663 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:12.534621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" event={"ID":"6d34e60f-da74-43c9-8009-9597c13ec4d2","Type":"ContainerStarted","Data":"68093788481ea97181fd1d65bfbc45fb59277be5ee854a47f48016cf931b2720"} Jun 09 10:57:12.803830 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:12.803788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:14.303962 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:14.303924 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:15.546704 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:15.546670 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" event={"ID":"6d34e60f-da74-43c9-8009-9597c13ec4d2","Type":"ContainerStarted","Data":"609cd8f7f1694dcd6efc1dbd11a941c390c2713cdb835fef4b8f0bb7b9f1d6a7"} Jun 09 10:57:15.564112 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:15.564055 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-4rvxg" podStartSLOduration=2.005477102 podStartE2EDuration="4.564040363s" totalImagesPullingTime="2.558563261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:15.563628634 +0000 UTC m=+214.097183709" watchObservedRunningTime="2026-06-09 10:57:15.564040363 +0000 UTC m=+214.097595443" Jun 09 10:57:15.888433 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:15.888343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:15.989525 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:15.989492 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:16.154334 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:16.154247 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:16.271443 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:16.271407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:16.386462 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:16.386427 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:16.492169 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:16.492127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:16.590358 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:16.590303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:17.584386 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:17.584343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:17.776277 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:17.776237 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:18.189403 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:18.189366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:18.382384 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:18.382351 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:18.777092 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:18.777056 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:19.381501 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.381466 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:19.488857 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.488819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:19.488857 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.488860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:19.489079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:19.488982 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 09 10:57:19.489079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:19.488991 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:35.488971863 +0000 UTC m=+234.022526923 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : configmap references non-existent config key: service-ca.crt Jun 09 10:57:19.489079 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:19.489036 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs podName:741fb71d-fff7-4a65-b5e1-15ae31bf9c12 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:35.489017096 +0000 UTC m=+234.022572154 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs") pod "router-default-754456dd49-6xrfv" (UID: "741fb71d-fff7-4a65-b5e1-15ae31bf9c12") : secret "router-metrics-certs-default" not found Jun 09 10:57:19.589925 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.589890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:19.592401 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.592368 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"image-registry-8695cd6dc5-58dmq\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:19.687469 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.687370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:19.690663 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.690628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:19.690779 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:19.690704 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 10:57:19.690779 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:19.690774 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert podName:184f2c3c-5894-4520-a346-3645bb9470c6 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:35.690753937 +0000 UTC m=+234.224309000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-nz968" (UID: "184f2c3c-5894-4520-a346-3645bb9470c6") : secret "networking-console-plugin-cert" not found Jun 09 10:57:19.821236 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:19.821204 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8695cd6dc5-58dmq"] Jun 09 10:57:19.824265 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:19.824238 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e6c9e8_1561_454b_9147_62d1ca81032e.slice/crio-2a5b8968a9e66338198fbd586b75399e41902c9b1d66e6b5560bba642349c9da WatchSource:0}: Error finding container 2a5b8968a9e66338198fbd586b75399e41902c9b1d66e6b5560bba642349c9da: Status 404 returned error can't find the container with id 2a5b8968a9e66338198fbd586b75399e41902c9b1d66e6b5560bba642349c9da Jun 09 10:57:20.400978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:20.400940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:20.563202 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:20.563159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" event={"ID":"93e6c9e8-1561-454b-9147-62d1ca81032e","Type":"ContainerStarted","Data":"c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49"} Jun 09 10:57:20.563372 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:20.563218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" event={"ID":"93e6c9e8-1561-454b-9147-62d1ca81032e","Type":"ContainerStarted","Data":"2a5b8968a9e66338198fbd586b75399e41902c9b1d66e6b5560bba642349c9da"} Jun 09 10:57:20.563372 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:20.563327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:20.584326 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:20.584274 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" podStartSLOduration=17.584258566 podStartE2EDuration="17.584258566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:20.582840419 +0000 UTC m=+219.116395498" watchObservedRunningTime="2026-06-09 10:57:20.584258566 +0000 UTC m=+219.117813645" Jun 09 10:57:20.784041 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:20.784004 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:21.594983 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:21.594942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:21.778511 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:21.778478 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:21.983895 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:21.983856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:22.385837 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:22.385753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:22.442613 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:22.442562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:22.985765 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:22.985728 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:23.388810 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:23.388727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:23.580841 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:23.580808 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:23.991481 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:23.991447 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:24.578859 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:24.578822 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:24.722890 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:24.722855 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:24.984563 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:24.984530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:25.386904 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:25.386818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:25.587906 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:25.587872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:26.187874 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:26.187843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:26.376689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:26.376658 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:26.581862 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:26.581818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:28.535649 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:28.535592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:28.591473 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:28.591442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:31.917752 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.917722 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8695cd6dc5-58dmq"] Jun 09 10:57:31.922155 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.922117 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9frhh"] Jun 09 10:57:31.927130 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.927111 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:31.930356 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.930334 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6cr7b\"" Jun 09 10:57:31.930963 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.930762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 10:57:31.930963 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.930783 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 10:57:31.930963 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.930790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 10:57:31.930963 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.930908 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 10:57:31.940701 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.940678 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9frhh"] Jun 09 10:57:31.964257 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.964229 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d8988757b-wlgp8"] Jun 09 10:57:31.967421 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.967404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:31.986978 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:31.986946 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d8988757b-wlgp8"] Jun 09 10:57:32.001035 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.001011 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:32.085844 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.085815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:32.086903 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.086883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6762a267-3a19-4494-b825-5854576af13d-image-registry-private-configuration\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.086956 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.086912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3a18652-23de-4d22-9152-71cdc8d581de-crio-socket\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.086956 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.086931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-bound-sa-token\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.086956 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.086954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6762a267-3a19-4494-b825-5854576af13d-registry-certificates\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.087048 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087024 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3a18652-23de-4d22-9152-71cdc8d581de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.087084 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3a18652-23de-4d22-9152-71cdc8d581de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.087084 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9xt4\" (UniqueName: \"kubernetes.io/projected/f3a18652-23de-4d22-9152-71cdc8d581de-kube-api-access-m9xt4\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.087144 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087086 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6762a267-3a19-4494-b825-5854576af13d-ca-trust-extracted\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.087176 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6762a267-3a19-4494-b825-5854576af13d-installation-pull-secrets\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.087209 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-registry-tls\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.087243 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087213 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6762a267-3a19-4494-b825-5854576af13d-trusted-ca\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.087243 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087231 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6qld\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-kube-api-access-t6qld\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.087304 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.087252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3a18652-23de-4d22-9152-71cdc8d581de-data-volume\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.188272 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6762a267-3a19-4494-b825-5854576af13d-image-registry-private-configuration\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.188272 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3a18652-23de-4d22-9152-71cdc8d581de-crio-socket\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.188272 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-bound-sa-token\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6762a267-3a19-4494-b825-5854576af13d-registry-certificates\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3a18652-23de-4d22-9152-71cdc8d581de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3a18652-23de-4d22-9152-71cdc8d581de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188386 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9xt4\" (UniqueName: \"kubernetes.io/projected/f3a18652-23de-4d22-9152-71cdc8d581de-kube-api-access-m9xt4\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6762a267-3a19-4494-b825-5854576af13d-ca-trust-extracted\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f3a18652-23de-4d22-9152-71cdc8d581de-crio-socket\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.188522 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6762a267-3a19-4494-b825-5854576af13d-installation-pull-secrets\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.189083 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-registry-tls\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.189083 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6762a267-3a19-4494-b825-5854576af13d-trusted-ca\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.189083 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6qld\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-kube-api-access-t6qld\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.189083 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3a18652-23de-4d22-9152-71cdc8d581de-data-volume\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.189083 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.188977 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3a18652-23de-4d22-9152-71cdc8d581de-data-volume\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.189353 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.189091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6762a267-3a19-4494-b825-5854576af13d-ca-trust-extracted\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.189353 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.189108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f3a18652-23de-4d22-9152-71cdc8d581de-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.189465 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.189412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6762a267-3a19-4494-b825-5854576af13d-registry-certificates\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.189934 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.189911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6762a267-3a19-4494-b825-5854576af13d-trusted-ca\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.191178 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.191150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6762a267-3a19-4494-b825-5854576af13d-installation-pull-secrets\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.191524 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.191501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f3a18652-23de-4d22-9152-71cdc8d581de-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.191589 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.191539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6762a267-3a19-4494-b825-5854576af13d-image-registry-private-configuration\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.191674 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.191645 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-registry-tls\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.198255 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.198234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9xt4\" (UniqueName: \"kubernetes.io/projected/f3a18652-23de-4d22-9152-71cdc8d581de-kube-api-access-m9xt4\") pod \"insights-runtime-extractor-9frhh\" (UID: \"f3a18652-23de-4d22-9152-71cdc8d581de\") " pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.198394 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.198374 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6qld\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-kube-api-access-t6qld\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.198579 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.198559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6762a267-3a19-4494-b825-5854576af13d-bound-sa-token\") pod \"image-registry-6d8988757b-wlgp8\" (UID: \"6762a267-3a19-4494-b825-5854576af13d\") " pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.236211 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.236184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9frhh" Jun 09 10:57:32.276448 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.276384 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.376940 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.376907 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9frhh"] Jun 09 10:57:32.382175 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:32.382142 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3a18652_23de_4d22_9152_71cdc8d581de.slice/crio-3432bfbd7665584a8c3f80a312bbf353c17ee16d1c0ede3d3e93946086e74260 WatchSource:0}: Error finding container 3432bfbd7665584a8c3f80a312bbf353c17ee16d1c0ede3d3e93946086e74260: Status 404 returned error can't find the container with id 3432bfbd7665584a8c3f80a312bbf353c17ee16d1c0ede3d3e93946086e74260 Jun 09 10:57:32.428097 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.428072 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d8988757b-wlgp8"] Jun 09 10:57:32.431029 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:32.431000 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6762a267_3a19_4494_b825_5854576af13d.slice/crio-be637a0642a6bc05ee82536b3f5c6177bc39c58c469cdbd6ea4699959817c061 WatchSource:0}: Error finding container be637a0642a6bc05ee82536b3f5c6177bc39c58c469cdbd6ea4699959817c061: Status 404 returned error can't find the container with id be637a0642a6bc05ee82536b3f5c6177bc39c58c469cdbd6ea4699959817c061 Jun 09 10:57:32.600274 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.600238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" event={"ID":"6762a267-3a19-4494-b825-5854576af13d","Type":"ContainerStarted","Data":"136417270d30e378c2079cbfec82e4d996a1688f309358a208e520ad7de3816c"} Jun 09 10:57:32.600496 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.600297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" event={"ID":"6762a267-3a19-4494-b825-5854576af13d","Type":"ContainerStarted","Data":"be637a0642a6bc05ee82536b3f5c6177bc39c58c469cdbd6ea4699959817c061"} Jun 09 10:57:32.600496 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.600335 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:57:32.601764 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.601732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9frhh" event={"ID":"f3a18652-23de-4d22-9152-71cdc8d581de","Type":"ContainerStarted","Data":"4f8c7dc74d1810c04c365656ea43beb615bb7e456753d8f9068e3d72c8dffac6"} Jun 09 10:57:32.601854 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.601774 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9frhh" event={"ID":"f3a18652-23de-4d22-9152-71cdc8d581de","Type":"ContainerStarted","Data":"3432bfbd7665584a8c3f80a312bbf353c17ee16d1c0ede3d3e93946086e74260"} Jun 09 10:57:32.620445 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:32.620406 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podStartSLOduration=1.62039286 podStartE2EDuration="1.62039286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:32.620192204 +0000 UTC m=+231.153747284" watchObservedRunningTime="2026-06-09 10:57:32.62039286 +0000 UTC m=+231.153947939" Jun 09 10:57:33.607039 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:33.606976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9frhh" event={"ID":"f3a18652-23de-4d22-9152-71cdc8d581de","Type":"ContainerStarted","Data":"959ac1cf1866b2926b7045f7a738dedef7aec6328fbc136cfa7103eaeec9e275"} Jun 09 10:57:35.516734 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.516688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:35.516734 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.516735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:35.517919 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.517896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-service-ca-bundle\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:35.519163 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.519144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/741fb71d-fff7-4a65-b5e1-15ae31bf9c12-metrics-certs\") pod \"router-default-754456dd49-6xrfv\" (UID: \"741fb71d-fff7-4a65-b5e1-15ae31bf9c12\") " pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:35.615907 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.615870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9frhh" event={"ID":"f3a18652-23de-4d22-9152-71cdc8d581de","Type":"ContainerStarted","Data":"520449212a91e32cbf8ac19243e7fb824f2ae22eff83d5b91b650c9bb958df26"} Jun 09 10:57:35.635814 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.635762 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9frhh" podStartSLOduration=2.395460713 podStartE2EDuration="4.635747458s" totalImagesPullingTime="2.240286745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 10:57:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:35.63378739 +0000 UTC m=+234.167342470" watchObservedRunningTime="2026-06-09 10:57:35.635747458 +0000 UTC m=+234.169302559" Jun 09 10:57:35.718132 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.718084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:35.720829 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.720803 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/184f2c3c-5894-4520-a346-3645bb9470c6-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-nz968\" (UID: \"184f2c3c-5894-4520-a346-3645bb9470c6\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:35.795749 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.795652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:35.931720 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.931685 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-754456dd49-6xrfv"] Jun 09 10:57:35.934499 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:35.934475 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741fb71d_fff7_4a65_b5e1_15ae31bf9c12.slice/crio-21d229a1a4261157c663dc514d8eb76e2959ae0a2ebd9dd45eea9d4fc37c51f9 WatchSource:0}: Error finding container 21d229a1a4261157c663dc514d8eb76e2959ae0a2ebd9dd45eea9d4fc37c51f9: Status 404 returned error can't find the container with id 21d229a1a4261157c663dc514d8eb76e2959ae0a2ebd9dd45eea9d4fc37c51f9 Jun 09 10:57:35.986676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:35.986652 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" Jun 09 10:57:36.115617 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.115571 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-nz968"] Jun 09 10:57:36.118568 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:36.118537 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184f2c3c_5894_4520_a346_3645bb9470c6.slice/crio-b4c2da513aacd89fac146bab6a020fd1e74ef30642dca4988f8f85975045a9bc WatchSource:0}: Error finding container b4c2da513aacd89fac146bab6a020fd1e74ef30642dca4988f8f85975045a9bc: Status 404 returned error can't find the container with id b4c2da513aacd89fac146bab6a020fd1e74ef30642dca4988f8f85975045a9bc Jun 09 10:57:36.621460 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.621418 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-754456dd49-6xrfv" event={"ID":"741fb71d-fff7-4a65-b5e1-15ae31bf9c12","Type":"ContainerStarted","Data":"81cec4bc8b09e7a9413225a8f6a5ef332ceb688f63f9a1c4b596054b26127f47"} Jun 09 10:57:36.621927 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.621474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-754456dd49-6xrfv" event={"ID":"741fb71d-fff7-4a65-b5e1-15ae31bf9c12","Type":"ContainerStarted","Data":"21d229a1a4261157c663dc514d8eb76e2959ae0a2ebd9dd45eea9d4fc37c51f9"} Jun 09 10:57:36.622589 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.622567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" event={"ID":"184f2c3c-5894-4520-a346-3645bb9470c6","Type":"ContainerStarted","Data":"b4c2da513aacd89fac146bab6a020fd1e74ef30642dca4988f8f85975045a9bc"} Jun 09 10:57:36.648257 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.648203 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-754456dd49-6xrfv" podStartSLOduration=33.64818546 podStartE2EDuration="33.64818546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:36.646423266 +0000 UTC m=+235.179978345" watchObservedRunningTime="2026-06-09 10:57:36.64818546 +0000 UTC m=+235.181740540" Jun 09 10:57:36.796408 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.796370 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:36.799451 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:36.799426 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:37.626943 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.626853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" event={"ID":"184f2c3c-5894-4520-a346-3645bb9470c6","Type":"ContainerStarted","Data":"a8cd658cd34dd5cc97057412581878ba6ca9ddcac832108ff6f26cfcdb058c31"} Jun 09 10:57:37.627313 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.627077 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:37.628379 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.628363 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-754456dd49-6xrfv" Jun 09 10:57:37.646102 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.646054 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-nz968" podStartSLOduration=33.484579351 podStartE2EDuration="34.646040506s" totalImagesPullingTime="1.161461155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:57:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:37.645891188 +0000 UTC m=+236.179446268" watchObservedRunningTime="2026-06-09 10:57:37.646040506 +0000 UTC m=+236.179595586" Jun 09 10:57:37.755247 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.755191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:37.856024 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.855990 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:37.916625 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:37.916510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:38.414176 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:38.414142 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:38.516661 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:38.516623 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:38.594947 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:38.594912 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:38.729013 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:38.728977 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:41.612619 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:41.612580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:41.701367 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:41.701333 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:41.909360 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:41.909276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:41.923283 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:41.923250 2562 patch_prober.go:28] interesting pod/image-registry-8695cd6dc5-58dmq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:57:41.923449 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:41.923304 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:57:43.197812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.197770 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:43.258412 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.258378 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:43.322365 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.322335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:43.563372 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.563342 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:43.663656 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.663592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:43.764061 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.764032 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:43.980497 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:43.980467 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:45.745337 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:45.745306 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:45.895556 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:45.895517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:45.997256 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:45.997164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.022120 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.022087 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lbmlj"] Jun 09 10:57:46.027323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.027295 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.030383 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.030359 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 10:57:46.030532 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.030440 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 10:57:46.030691 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.030670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pj64z\"" Jun 09 10:57:46.031597 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.031579 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 10:57:46.031704 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.031585 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 10:57:46.031704 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.031595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 10:57:46.031822 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.031595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 10:57:46.079840 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.079804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.099403 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099594 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-wtmp\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099594 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099594 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-sys\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099594 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099594 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-textfile\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099594 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099587 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4smbs\" (UniqueName: \"kubernetes.io/projected/2e110f5d-ffff-418b-b129-0c1b67a13ce7-kube-api-access-4smbs\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099913 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e110f5d-ffff-418b-b129-0c1b67a13ce7-metrics-client-ca\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.099913 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.099747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-root\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.149408 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.149374 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.201016 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.200977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e110f5d-ffff-418b-b129-0c1b67a13ce7-metrics-client-ca\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-root\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-wtmp\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-sys\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-textfile\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201216 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4smbs\" (UniqueName: \"kubernetes.io/projected/2e110f5d-ffff-418b-b129-0c1b67a13ce7-kube-api-access-4smbs\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201637 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-wtmp\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201698 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-sys\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201698 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:46.201658 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 10:57:46.201698 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2e110f5d-ffff-418b-b129-0c1b67a13ce7-metrics-client-ca\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.201847 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:46.201710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls podName:2e110f5d-ffff-418b-b129-0c1b67a13ce7 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:46.701693128 +0000 UTC m=+245.235248186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls") pod "node-exporter-lbmlj" (UID: "2e110f5d-ffff-418b-b129-0c1b67a13ce7") : secret "node-exporter-tls" not found Jun 09 10:57:46.201847 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.201735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2e110f5d-ffff-418b-b129-0c1b67a13ce7-root\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.202139 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.202117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-accelerators-collector-config\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.202200 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.202150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-textfile\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.203877 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.203847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.224997 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.224961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4smbs\" (UniqueName: \"kubernetes.io/projected/2e110f5d-ffff-418b-b129-0c1b67a13ce7-kube-api-access-4smbs\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.256640 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.256523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.357590 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.357553 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.450821 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.450781 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.524868 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.524779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.625691 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.625654 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:46.705448 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.705406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:46.705675 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:46.705583 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 10:57:46.705758 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:46.705689 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls podName:2e110f5d-ffff-418b-b129-0c1b67a13ce7 nodeName:}" failed. No retries permitted until 2026-06-09 10:57:47.705665896 +0000 UTC m=+246.239220954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls") pod "node-exporter-lbmlj" (UID: "2e110f5d-ffff-418b-b129-0c1b67a13ce7") : secret "node-exporter-tls" not found Jun 09 10:57:46.785815 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:46.785734 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:47.049548 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:47.049460 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:47.147912 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:47.147877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:47.261747 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:47.261712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:47.714588 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:47.714551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:47.717043 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:47.717022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2e110f5d-ffff-418b-b129-0c1b67a13ce7-node-exporter-tls\") pod \"node-exporter-lbmlj\" (UID: \"2e110f5d-ffff-418b-b129-0c1b67a13ce7\") " pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:47.838534 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:47.838481 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lbmlj" Jun 09 10:57:47.850151 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:47.850122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e110f5d_ffff_418b_b129_0c1b67a13ce7.slice/crio-0419e72e8fb797ccd00798782232db1b3a6d511e6fd39bee0fdec1ef64be42f4 WatchSource:0}: Error finding container 0419e72e8fb797ccd00798782232db1b3a6d511e6fd39bee0fdec1ef64be42f4: Status 404 returned error can't find the container with id 0419e72e8fb797ccd00798782232db1b3a6d511e6fd39bee0fdec1ef64be42f4 Jun 09 10:57:48.664505 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:48.664478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbmlj" event={"ID":"2e110f5d-ffff-418b-b129-0c1b67a13ce7","Type":"ContainerStarted","Data":"0419e72e8fb797ccd00798782232db1b3a6d511e6fd39bee0fdec1ef64be42f4"} Jun 09 10:57:48.920809 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:48.920706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:48.999554 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:48.999519 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:49.116786 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:49.116747 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:49.218551 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:49.218462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:49.669165 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:49.669129 2562 generic.go:356] "Generic (PLEG): container finished" podID="2e110f5d-ffff-418b-b129-0c1b67a13ce7" containerID="1f255cbe0a4b8b710bc8a2e9ef6abca0d23ea49da3a41dc9b43701955544dbad" exitCode=0 Jun 09 10:57:49.669362 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:49.669233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbmlj" event={"ID":"2e110f5d-ffff-418b-b129-0c1b67a13ce7","Type":"ContainerDied","Data":"1f255cbe0a4b8b710bc8a2e9ef6abca0d23ea49da3a41dc9b43701955544dbad"} Jun 09 10:57:50.674723 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:50.674678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbmlj" event={"ID":"2e110f5d-ffff-418b-b129-0c1b67a13ce7","Type":"ContainerStarted","Data":"e33111d85873472ce516676efd5c5998097ebbb44e10ce8245d7c5ea926e9ea7"} Jun 09 10:57:50.675124 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:50.674739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lbmlj" event={"ID":"2e110f5d-ffff-418b-b129-0c1b67a13ce7","Type":"ContainerStarted","Data":"10a4071068af882d0a93465e1afc620049fca189e0c340000aa53aebf8d223cc"} Jun 09 10:57:50.696077 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:50.696027 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lbmlj" podStartSLOduration=4.820711905 podStartE2EDuration="5.696010955s" totalImagesPullingTime="802.460603ms" totalInitContainerRuntime="72.838447ms" isStatefulPod=true podCreationTimestamp="2026-06-09 10:57:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:50.694433506 +0000 UTC m=+249.227988587" watchObservedRunningTime="2026-06-09 10:57:50.696010955 +0000 UTC m=+249.229566034" Jun 09 10:57:50.765538 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:50.765498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:51.525895 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:51.525863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:51.921878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:51.921796 2562 patch_prober.go:28] interesting pod/image-registry-8695cd6dc5-58dmq container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:57:51.921878 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:51.921845 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:57:52.165554 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:52.165522 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:52.281427 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:52.281394 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:57:52.281642 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:52.281454 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:57:53.611537 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:53.611449 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:57:53.611537 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:53.611503 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:57:53.665473 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:53.665422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:57:53.668030 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:53.668002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fbe71c5d-3b91-4888-bbfe-f207c6f8bf54-metrics-certs\") pod \"network-metrics-daemon-68ngr\" (UID: \"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54\") " pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:57:53.874396 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:53.874320 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qfn6d\"" Jun 09 10:57:53.881653 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:53.881633 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-68ngr" Jun 09 10:57:54.008743 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:54.008718 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-68ngr"] Jun 09 10:57:54.011469 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:57:54.011440 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe71c5d_3b91_4888_bbfe_f207c6f8bf54.slice/crio-d5ab85f4730e5ce9dfb064fcb9e21e539f3518c15959c36f91de8c5c3655d076 WatchSource:0}: Error finding container d5ab85f4730e5ce9dfb064fcb9e21e539f3518c15959c36f91de8c5c3655d076: Status 404 returned error can't find the container with id d5ab85f4730e5ce9dfb064fcb9e21e539f3518c15959c36f91de8c5c3655d076 Jun 09 10:57:54.689109 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:54.689073 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-68ngr" event={"ID":"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54","Type":"ContainerStarted","Data":"d5ab85f4730e5ce9dfb064fcb9e21e539f3518c15959c36f91de8c5c3655d076"} Jun 09 10:57:55.694826 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:55.694788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-68ngr" event={"ID":"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54","Type":"ContainerStarted","Data":"5fe1bdf72523625ab3732ad44280c7ae04a8cf93fc378543a727c872798cb13b"} Jun 09 10:57:55.695221 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:55.694847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-68ngr" event={"ID":"fbe71c5d-3b91-4888-bbfe-f207c6f8bf54","Type":"ContainerStarted","Data":"755db3e5b80dbff27739012c6373db34d572cb0064ef8d5c7449c99e8ba852b9"} Jun 09 10:57:55.712850 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:55.712800 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-68ngr" podStartSLOduration=252.866792668 podStartE2EDuration="4m13.71278156s" totalImagesPullingTime="845.988892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:53:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:57:55.711778954 +0000 UTC m=+254.245334035" watchObservedRunningTime="2026-06-09 10:57:55.71278156 +0000 UTC m=+254.246336644" Jun 09 10:57:55.806130 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:55.806091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:55.907857 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:55.907825 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:57:56.938807 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:56.938748 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerName="registry" containerID="cri-o://c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49" gracePeriod=30 Jun 09 10:57:57.184717 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.184693 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:57.296125 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296082 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfjwb\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-kube-api-access-hfjwb\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296125 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296125 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-image-registry-private-configuration\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296156 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296194 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-trusted-ca\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296218 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93e6c9e8-1561-454b-9147-62d1ca81032e-ca-trust-extracted\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296256 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-certificates\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296287 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-installation-pull-secrets\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296349 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296308 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-bound-sa-token\") pod \"93e6c9e8-1561-454b-9147-62d1ca81032e\" (UID: \"93e6c9e8-1561-454b-9147-62d1ca81032e\") " Jun 09 10:57:57.296901 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296802 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:57:57.296901 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.296839 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:57:57.298719 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.298682 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-kube-api-access-hfjwb" (OuterVolumeSpecName: "kube-api-access-hfjwb") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "kube-api-access-hfjwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:57:57.298888 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.298852 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:57:57.298967 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.298935 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:57:57.299187 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.299170 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:57:57.299263 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.299241 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:57:57.304908 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.304881 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e6c9e8-1561-454b-9147-62d1ca81032e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "93e6c9e8-1561-454b-9147-62d1ca81032e" (UID: "93e6c9e8-1561-454b-9147-62d1ca81032e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 10:57:57.397821 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397788 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-certificates\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.397821 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397815 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-installation-pull-secrets\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.397821 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397826 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-bound-sa-token\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.398036 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397835 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfjwb\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-kube-api-access-hfjwb\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.398036 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397846 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/93e6c9e8-1561-454b-9147-62d1ca81032e-image-registry-private-configuration\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.398036 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397855 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/93e6c9e8-1561-454b-9147-62d1ca81032e-registry-tls\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.398036 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397863 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/93e6c9e8-1561-454b-9147-62d1ca81032e-trusted-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.398036 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.397871 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/93e6c9e8-1561-454b-9147-62d1ca81032e-ca-trust-extracted\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:57:57.705718 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.705635 2562 generic.go:356] "Generic (PLEG): container finished" podID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerID="c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49" exitCode=0 Jun 09 10:57:57.705718 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.705682 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" event={"ID":"93e6c9e8-1561-454b-9147-62d1ca81032e","Type":"ContainerDied","Data":"c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49"} Jun 09 10:57:57.705896 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.705730 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" event={"ID":"93e6c9e8-1561-454b-9147-62d1ca81032e","Type":"ContainerDied","Data":"2a5b8968a9e66338198fbd586b75399e41902c9b1d66e6b5560bba642349c9da"} Jun 09 10:57:57.705896 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.705733 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8695cd6dc5-58dmq" Jun 09 10:57:57.705896 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.705747 2562 scope.go:117] "RemoveContainer" containerID="c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49" Jun 09 10:57:57.714650 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.714631 2562 scope.go:117] "RemoveContainer" containerID="c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49" Jun 09 10:57:57.714903 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:57:57.714885 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49\": container with ID starting with c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49 not found: ID does not exist" containerID="c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49" Jun 09 10:57:57.714950 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.714911 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49"} err="failed to get container status \"c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49\": rpc error: code = NotFound desc = could not find container \"c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49\": container with ID starting with c16033c6a554162ada25c7184698ca4a26407164f90d66ea838e2a1c5dff2a49 not found: ID does not exist" Jun 09 10:57:57.730073 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.728510 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8695cd6dc5-58dmq"] Jun 09 10:57:57.733683 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.733657 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8695cd6dc5-58dmq"] Jun 09 10:57:57.875172 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:57:57.875125 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" path="/var/lib/kubelet/pods/93e6c9e8-1561-454b-9147-62d1ca81032e/volumes" Jun 09 10:58:02.243457 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.243417 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-nz7rj"] Jun 09 10:58:02.243940 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.243699 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerName="registry" Jun 09 10:58:02.243940 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.243711 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerName="registry" Jun 09 10:58:02.243940 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.243780 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e6c9e8-1561-454b-9147-62d1ca81032e" containerName="registry" Jun 09 10:58:02.246626 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.246582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:02.249083 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.249052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:02.249651 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.249624 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 10:58:02.249651 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.249648 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 10:58:02.249851 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.249649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sdrxx\"" Jun 09 10:58:02.260021 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.259994 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nz7rj"] Jun 09 10:58:02.280759 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.280727 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:02.280921 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.280784 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:02.336299 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.336258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cxmr\" (UniqueName: \"kubernetes.io/projected/b4f34111-2c72-4bf9-9c31-607890a7485b-kube-api-access-4cxmr\") pod \"downloads-6657875f97-nz7rj\" (UID: \"b4f34111-2c72-4bf9-9c31-607890a7485b\") " pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:02.347159 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.347127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:02.408701 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.408666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:02.436684 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.436647 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cxmr\" (UniqueName: \"kubernetes.io/projected/b4f34111-2c72-4bf9-9c31-607890a7485b-kube-api-access-4cxmr\") pod \"downloads-6657875f97-nz7rj\" (UID: \"b4f34111-2c72-4bf9-9c31-607890a7485b\") " pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:02.445747 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.445717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cxmr\" (UniqueName: \"kubernetes.io/projected/b4f34111-2c72-4bf9-9c31-607890a7485b-kube-api-access-4cxmr\") pod \"downloads-6657875f97-nz7rj\" (UID: \"b4f34111-2c72-4bf9-9c31-607890a7485b\") " pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:02.526057 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.525975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:02.556709 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.556672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:02.687202 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.687166 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-nz7rj"] Jun 09 10:58:02.690078 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:58:02.690041 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4f34111_2c72_4bf9_9c31_607890a7485b.slice/crio-fbf6678115e91186542615b2ee523e6ac7bdee4f616b452698b35a009b1888dd WatchSource:0}: Error finding container fbf6678115e91186542615b2ee523e6ac7bdee4f616b452698b35a009b1888dd: Status 404 returned error can't find the container with id fbf6678115e91186542615b2ee523e6ac7bdee4f616b452698b35a009b1888dd Jun 09 10:58:02.712481 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.712451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:02.724264 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.724235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nz7rj" event={"ID":"b4f34111-2c72-4bf9-9c31-607890a7485b","Type":"ContainerStarted","Data":"fbf6678115e91186542615b2ee523e6ac7bdee4f616b452698b35a009b1888dd"} Jun 09 10:58:02.775181 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:02.775145 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:03.136854 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.136819 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:03.193252 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.193208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:03.317133 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.317103 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:03.386385 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.386347 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:03.613117 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.613067 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:03.613316 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.613135 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:03.916641 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:03.916523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:04.112841 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:04.112699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:04.283905 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:04.283867 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:05.380241 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:05.380204 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:05.936031 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:05.935988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:05.991281 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:05.991238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:07.137480 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:07.137430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:07.190117 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:07.190008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:12.281301 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:12.281260 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:12.281745 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:12.281317 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:12.281745 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:12.281362 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:58:12.281943 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:12.281924 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"136417270d30e378c2079cbfec82e4d996a1688f309358a208e520ad7de3816c"} pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 10:58:12.285575 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:12.285541 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:12.285713 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:12.285581 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:13.357375 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.357335 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56db7d898c-tx6fx"] Jun 09 10:58:13.366810 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.366788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.373217 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.372986 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 10:58:13.373217 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.373050 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 10:58:13.373217 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.373090 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 10:58:13.373217 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.373103 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-5tsrf\"" Jun 09 10:58:13.373217 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.372990 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 10:58:13.373661 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.373336 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 10:58:13.374771 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.374463 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56db7d898c-tx6fx"] Jun 09 10:58:13.429889 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.429848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-serving-cert\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.430106 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.429897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-oauth-config\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.430106 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.429925 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-oauth-serving-cert\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.430106 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.430013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-console-config\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.430106 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.430047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztb6\" (UniqueName: \"kubernetes.io/projected/ef767856-7f05-477a-99b0-c362681949eb-kube-api-access-bztb6\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.430251 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.430143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-service-ca\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.531217 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.531175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-service-ca\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.531437 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.531245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-serving-cert\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.531437 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.531275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-oauth-config\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.531562 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.531491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-oauth-serving-cert\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.531647 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.531559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-console-config\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.531647 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.531585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztb6\" (UniqueName: \"kubernetes.io/projected/ef767856-7f05-477a-99b0-c362681949eb-kube-api-access-bztb6\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.532062 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.532013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-service-ca\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.532652 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.532630 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-oauth-serving-cert\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.532747 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.532713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-console-config\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.534317 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.534294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-oauth-config\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.534487 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.534431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-serving-cert\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.540921 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.540894 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztb6\" (UniqueName: \"kubernetes.io/projected/ef767856-7f05-477a-99b0-c362681949eb-kube-api-access-bztb6\") pod \"console-56db7d898c-tx6fx\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.553762 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.553731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:13.610056 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.609958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:13.676813 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.676779 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:13.834185 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:13.834062 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56db7d898c-tx6fx"] Jun 09 10:58:13.837918 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:58:13.837889 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef767856_7f05_477a_99b0_c362681949eb.slice/crio-2f6c48924ea24299aeabff009aef989a7f58fa2c6aa26bdd28d560e6b829097a WatchSource:0}: Error finding container 2f6c48924ea24299aeabff009aef989a7f58fa2c6aa26bdd28d560e6b829097a: Status 404 returned error can't find the container with id 2f6c48924ea24299aeabff009aef989a7f58fa2c6aa26bdd28d560e6b829097a Jun 09 10:58:14.777025 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:14.776988 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db7d898c-tx6fx" event={"ID":"ef767856-7f05-477a-99b0-c362681949eb","Type":"ContainerStarted","Data":"2f6c48924ea24299aeabff009aef989a7f58fa2c6aa26bdd28d560e6b829097a"} Jun 09 10:58:16.339364 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:16.339320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:16.396703 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:16.396661 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:20.140154 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:20.140112 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:20.210038 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:20.209993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:22.287181 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:22.287138 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:22.287727 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:22.287206 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:23.397142 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:58:23.397081 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-9vltf" podUID="af36d076-fc63-41fc-9e65-53b0254bb0b4" Jun 09 10:58:23.536382 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.536342 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5758876596-j25mf"] Jun 09 10:58:23.539760 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.539727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.549783 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.549753 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 10:58:23.551915 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.551852 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5758876596-j25mf"] Jun 09 10:58:23.619465 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-service-ca\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.619689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-oauth-config\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.619689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dh4x\" (UniqueName: \"kubernetes.io/projected/5cd014c7-1097-47ae-a353-ecbf641aa16b-kube-api-access-9dh4x\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.619689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-serving-cert\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.619689 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-oauth-serving-cert\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.619937 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-trusted-ca-bundle\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.619937 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.619734 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-config\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.720995 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.720956 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-service-ca\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721185 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-oauth-config\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721185 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dh4x\" (UniqueName: \"kubernetes.io/projected/5cd014c7-1097-47ae-a353-ecbf641aa16b-kube-api-access-9dh4x\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721185 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-serving-cert\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721185 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-oauth-serving-cert\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721405 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-trusted-ca-bundle\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721405 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-config\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.721897 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.721861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-service-ca\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.722723 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.722084 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-oauth-serving-cert\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.722723 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.722675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-trusted-ca-bundle\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.723323 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.723303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-config\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.724224 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.724200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-oauth-config\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.724659 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.724635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-serving-cert\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.730223 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.730200 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dh4x\" (UniqueName: \"kubernetes.io/projected/5cd014c7-1097-47ae-a353-ecbf641aa16b-kube-api-access-9dh4x\") pod \"console-5758876596-j25mf\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.820312 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.820258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-nz7rj" event={"ID":"b4f34111-2c72-4bf9-9c31-607890a7485b","Type":"ContainerStarted","Data":"2e19d5f82f708d0d6215065ce838bf3c2943e972a23e01766569fbdc17e29164"} Jun 09 10:58:23.820511 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.820369 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:23.822483 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.822444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db7d898c-tx6fx" event={"ID":"ef767856-7f05-477a-99b0-c362681949eb","Type":"ContainerStarted","Data":"a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa"} Jun 09 10:58:23.822659 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.822508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vltf" Jun 09 10:58:23.836237 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.836202 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-nz7rj" Jun 09 10:58:23.838850 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.838768 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-nz7rj" podStartSLOduration=1.549335269 podStartE2EDuration="21.838751225s" totalImagesPullingTime="20.289415956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:23.838169507 +0000 UTC m=+282.371724587" watchObservedRunningTime="2026-06-09 10:58:23.838751225 +0000 UTC m=+282.372306305" Jun 09 10:58:23.851820 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.851792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:23.858299 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:23.858236 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56db7d898c-tx6fx" podStartSLOduration=1.754707934 podStartE2EDuration="10.858216679s" totalImagesPullingTime="9.103508745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:23.856700815 +0000 UTC m=+282.390255898" watchObservedRunningTime="2026-06-09 10:58:23.858216679 +0000 UTC m=+282.391771760" Jun 09 10:58:24.022386 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:24.022211 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5758876596-j25mf"] Jun 09 10:58:24.025757 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:58:24.025729 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cd014c7_1097_47ae_a353_ecbf641aa16b.slice/crio-a9ee69949891aa0c44dad8712484d0a5cc7f99fcecd6e5b1c370219673f6709e WatchSource:0}: Error finding container a9ee69949891aa0c44dad8712484d0a5cc7f99fcecd6e5b1c370219673f6709e: Status 404 returned error can't find the container with id a9ee69949891aa0c44dad8712484d0a5cc7f99fcecd6e5b1c370219673f6709e Jun 09 10:58:24.738624 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:24.738558 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:24.797295 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:24.797252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:24.828923 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:24.828882 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5758876596-j25mf" event={"ID":"5cd014c7-1097-47ae-a353-ecbf641aa16b","Type":"ContainerStarted","Data":"de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030"} Jun 09 10:58:24.829135 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:24.828942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5758876596-j25mf" event={"ID":"5cd014c7-1097-47ae-a353-ecbf641aa16b","Type":"ContainerStarted","Data":"a9ee69949891aa0c44dad8712484d0a5cc7f99fcecd6e5b1c370219673f6709e"} Jun 09 10:58:24.849870 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:24.849814 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5758876596-j25mf" podStartSLOduration=1.849796992 podStartE2EDuration="1.849796992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:58:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:24.848431342 +0000 UTC m=+283.381986423" watchObservedRunningTime="2026-06-09 10:58:24.849796992 +0000 UTC m=+283.383352141" Jun 09 10:58:26.850909 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:26.850875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:58:26.853757 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:26.853730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af36d076-fc63-41fc-9e65-53b0254bb0b4-metrics-tls\") pod \"dns-default-9vltf\" (UID: \"af36d076-fc63-41fc-9e65-53b0254bb0b4\") " pod="openshift-dns/dns-default-9vltf" Jun 09 10:58:27.126328 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:27.126243 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k9trm\"" Jun 09 10:58:27.133637 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:27.133589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vltf" Jun 09 10:58:27.314673 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:27.314639 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vltf"] Jun 09 10:58:27.317470 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:58:27.317437 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf36d076_fc63_41fc_9e65_53b0254bb0b4.slice/crio-7f36c70ecca952dcd16cda612e27bf053ee24577b8afdc877ae19fadc1c194b9 WatchSource:0}: Error finding container 7f36c70ecca952dcd16cda612e27bf053ee24577b8afdc877ae19fadc1c194b9: Status 404 returned error can't find the container with id 7f36c70ecca952dcd16cda612e27bf053ee24577b8afdc877ae19fadc1c194b9 Jun 09 10:58:27.844987 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:27.844940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vltf" event={"ID":"af36d076-fc63-41fc-9e65-53b0254bb0b4","Type":"ContainerStarted","Data":"7f36c70ecca952dcd16cda612e27bf053ee24577b8afdc877ae19fadc1c194b9"} Jun 09 10:58:28.523733 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:28.523696 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:28.591843 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:28.591808 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:29.856865 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:29.856709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vltf" event={"ID":"af36d076-fc63-41fc-9e65-53b0254bb0b4","Type":"ContainerStarted","Data":"d4c0f9c83d2ba3dc20824c40d9d288dca10bcbcd8f46e218b75775660751ac74"} Jun 09 10:58:30.865388 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:30.865344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vltf" event={"ID":"af36d076-fc63-41fc-9e65-53b0254bb0b4","Type":"ContainerStarted","Data":"c619a1bfe685709c20d645b2e41603f9db9280a17fa1788eebc0d94f37eb9bbd"} Jun 09 10:58:30.865906 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:30.865486 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9vltf" Jun 09 10:58:30.886029 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:30.885969 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9vltf" podStartSLOduration=252.606906607 podStartE2EDuration="4m14.885946224s" totalImagesPullingTime="2.279039617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:58:30.885484488 +0000 UTC m=+289.419039569" watchObservedRunningTime="2026-06-09 10:58:30.885946224 +0000 UTC m=+289.419501304" Jun 09 10:58:31.545842 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:31.545789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:31.645895 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:31.645855 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:32.286306 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:32.286270 2562 patch_prober.go:28] interesting pod/image-registry-6d8988757b-wlgp8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 10:58:32.286854 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:32.286323 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 10:58:33.677693 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.677651 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:33.678085 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.677739 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:33.682580 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.682553 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:33.852879 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.852838 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:33.853079 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.852908 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:33.857797 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.857765 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:33.881341 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.881304 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:58:33.881781 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.881761 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:58:33.951862 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:33.951773 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56db7d898c-tx6fx"] Jun 09 10:58:34.541858 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:34.541801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:36.376921 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:36.376888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:36.971733 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:36.971663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:37.031370 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:37.031336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:37.300959 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:37.300871 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" podUID="6762a267-3a19-4494-b825-5854576af13d" containerName="registry" containerID="cri-o://136417270d30e378c2079cbfec82e4d996a1688f309358a208e520ad7de3816c" gracePeriod=30 Jun 09 10:58:38.896206 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:38.896172 2562 generic.go:356] "Generic (PLEG): container finished" podID="6762a267-3a19-4494-b825-5854576af13d" containerID="136417270d30e378c2079cbfec82e4d996a1688f309358a208e520ad7de3816c" exitCode=0 Jun 09 10:58:38.896580 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:38.896223 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" event={"ID":"6762a267-3a19-4494-b825-5854576af13d","Type":"ContainerDied","Data":"136417270d30e378c2079cbfec82e4d996a1688f309358a208e520ad7de3816c"} Jun 09 10:58:39.520801 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:39.520777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754456dd49-6xrfv_741fb71d-fff7-4a65-b5e1-15ae31bf9c12/router/0.log" Jun 09 10:58:39.526300 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:39.526275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7mk6z_f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0/serve-healthcheck-canary/0.log" Jun 09 10:58:39.900876 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:39.900778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" event={"ID":"6762a267-3a19-4494-b825-5854576af13d","Type":"ContainerStarted","Data":"d70bcc4ae546bc3bfa323e630be2ca586bfe3d4e16330d69631b7cf3fbca0414"} Jun 09 10:58:39.901304 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:39.900926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:58:40.872433 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:40.872404 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9vltf" Jun 09 10:58:41.818838 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:41.818813 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 10:58:44.845029 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:44.844994 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:44.898297 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:44.898259 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:47.328796 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:47.328758 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:47.424060 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:47.424027 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:47.523798 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:47.523762 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:50.038076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:50.038030 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:50.138292 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:50.138255 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:51.642395 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:51.642344 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:51.745124 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:51.745048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:54.011359 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:54.011316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:54.111630 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:54.111573 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:58.531101 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:58.531052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:58:58.600192 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:58:58.600161 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:00.904930 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:00.904876 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56db7d898c-tx6fx" podUID="ef767856-7f05-477a-99b0-c362681949eb" containerName="console" containerID="cri-o://a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa" gracePeriod=15 Jun 09 10:59:00.910551 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:00.910520 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6d8988757b-wlgp8" Jun 09 10:59:01.049061 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.049014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:01.105567 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.105536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:01.182186 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.182111 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:59:01.219676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.219641 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-serving-cert\") pod \"ef767856-7f05-477a-99b0-c362681949eb\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " Jun 09 10:59:01.219676 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.219679 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-oauth-config\") pod \"ef767856-7f05-477a-99b0-c362681949eb\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " Jun 09 10:59:01.219924 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.219740 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-oauth-serving-cert\") pod \"ef767856-7f05-477a-99b0-c362681949eb\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " Jun 09 10:59:01.219924 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.219760 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-console-config\") pod \"ef767856-7f05-477a-99b0-c362681949eb\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " Jun 09 10:59:01.219924 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.219817 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bztb6\" (UniqueName: \"kubernetes.io/projected/ef767856-7f05-477a-99b0-c362681949eb-kube-api-access-bztb6\") pod \"ef767856-7f05-477a-99b0-c362681949eb\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " Jun 09 10:59:01.219924 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.219833 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-service-ca\") pod \"ef767856-7f05-477a-99b0-c362681949eb\" (UID: \"ef767856-7f05-477a-99b0-c362681949eb\") " Jun 09 10:59:01.220218 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.220180 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ef767856-7f05-477a-99b0-c362681949eb" (UID: "ef767856-7f05-477a-99b0-c362681949eb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:01.220330 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.220213 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-console-config" (OuterVolumeSpecName: "console-config") pod "ef767856-7f05-477a-99b0-c362681949eb" (UID: "ef767856-7f05-477a-99b0-c362681949eb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:01.220330 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.220284 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-service-ca" (OuterVolumeSpecName: "service-ca") pod "ef767856-7f05-477a-99b0-c362681949eb" (UID: "ef767856-7f05-477a-99b0-c362681949eb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:01.222210 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.222182 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ef767856-7f05-477a-99b0-c362681949eb" (UID: "ef767856-7f05-477a-99b0-c362681949eb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:01.222326 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.222268 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ef767856-7f05-477a-99b0-c362681949eb" (UID: "ef767856-7f05-477a-99b0-c362681949eb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:01.222387 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.222326 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef767856-7f05-477a-99b0-c362681949eb-kube-api-access-bztb6" (OuterVolumeSpecName: "kube-api-access-bztb6") pod "ef767856-7f05-477a-99b0-c362681949eb" (UID: "ef767856-7f05-477a-99b0-c362681949eb"). InnerVolumeSpecName "kube-api-access-bztb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:01.256733 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.256693 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:01.320543 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.320510 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bztb6\" (UniqueName: \"kubernetes.io/projected/ef767856-7f05-477a-99b0-c362681949eb-kube-api-access-bztb6\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:01.320543 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.320543 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-service-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:01.320773 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.320556 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-serving-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:01.320773 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.320571 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ef767856-7f05-477a-99b0-c362681949eb-console-oauth-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:01.320773 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.320582 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-oauth-serving-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:01.320773 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.320594 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ef767856-7f05-477a-99b0-c362681949eb-console-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:01.357957 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.357921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:01.982743 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.982705 2562 generic.go:356] "Generic (PLEG): container finished" podID="ef767856-7f05-477a-99b0-c362681949eb" containerID="a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa" exitCode=0 Jun 09 10:59:01.982743 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.982750 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db7d898c-tx6fx" event={"ID":"ef767856-7f05-477a-99b0-c362681949eb","Type":"ContainerDied","Data":"a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa"} Jun 09 10:59:01.983271 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.982759 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56db7d898c-tx6fx" Jun 09 10:59:01.983271 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.982790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56db7d898c-tx6fx" event={"ID":"ef767856-7f05-477a-99b0-c362681949eb","Type":"ContainerDied","Data":"2f6c48924ea24299aeabff009aef989a7f58fa2c6aa26bdd28d560e6b829097a"} Jun 09 10:59:01.983271 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.982810 2562 scope.go:117] "RemoveContainer" containerID="a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa" Jun 09 10:59:01.992381 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.992361 2562 scope.go:117] "RemoveContainer" containerID="a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa" Jun 09 10:59:01.992721 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:59:01.992697 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa\": container with ID starting with a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa not found: ID does not exist" containerID="a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa" Jun 09 10:59:01.992816 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:01.992733 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa"} err="failed to get container status \"a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa\": rpc error: code = NotFound desc = could not find container \"a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa\": container with ID starting with a218dc13dd099110e644479e258e49f3bf35ba24c0462a9b748906d5cc8890aa not found: ID does not exist" Jun 09 10:59:02.004796 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.004764 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56db7d898c-tx6fx"] Jun 09 10:59:02.008896 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.008873 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56db7d898c-tx6fx"] Jun 09 10:59:02.057583 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.057551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:02.121806 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.121764 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:02.237245 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.237212 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85b9df46f6-rhqk7"] Jun 09 10:59:02.237475 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.237463 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef767856-7f05-477a-99b0-c362681949eb" containerName="console" Jun 09 10:59:02.237517 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.237477 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef767856-7f05-477a-99b0-c362681949eb" containerName="console" Jun 09 10:59:02.237550 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.237523 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef767856-7f05-477a-99b0-c362681949eb" containerName="console" Jun 09 10:59:02.265290 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.265251 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b9df46f6-rhqk7"] Jun 09 10:59:02.265449 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.265390 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328167 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-service-ca\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328167 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328168 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-oauth-serving-cert\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328392 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-oauth-config\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328392 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328259 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx2j5\" (UniqueName: \"kubernetes.io/projected/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-kube-api-access-xx2j5\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328392 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-serving-cert\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328392 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328345 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-config\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.328532 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.328402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-trusted-ca-bundle\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.419633 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.419587 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:02.428746 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428720 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-service-ca\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.428834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-oauth-serving-cert\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.428834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-oauth-config\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.428834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx2j5\" (UniqueName: \"kubernetes.io/projected/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-kube-api-access-xx2j5\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.428834 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428818 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-serving-cert\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.429016 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-config\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.429016 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.428887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-trusted-ca-bundle\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.429766 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.429591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-service-ca\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.429766 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.429653 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-config\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.429766 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.429719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-oauth-serving-cert\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.429923 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.429788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-trusted-ca-bundle\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.432040 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.432020 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-oauth-config\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.432094 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.432024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-serving-cert\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.438993 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.438951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx2j5\" (UniqueName: \"kubernetes.io/projected/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-kube-api-access-xx2j5\") pod \"console-85b9df46f6-rhqk7\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.485751 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.485710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:02.574076 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.573993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:02.643184 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.643143 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:02.755637 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.755572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:02.757410 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.757388 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85b9df46f6-rhqk7"] Jun 09 10:59:02.759482 ip-10-0-132-253 kubenswrapper[2562]: W0609 10:59:02.759453 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b56b53_6b5e_426b_b4c6_a9621c6a85f9.slice/crio-51b2faf52d43e44c364bbb5799a70f6209ebd363079d620f28a3118219c71802 WatchSource:0}: Error finding container 51b2faf52d43e44c364bbb5799a70f6209ebd363079d620f28a3118219c71802: Status 404 returned error can't find the container with id 51b2faf52d43e44c364bbb5799a70f6209ebd363079d620f28a3118219c71802 Jun 09 10:59:02.988986 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.988943 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b9df46f6-rhqk7" event={"ID":"25b56b53-6b5e-426b-b4c6-a9621c6a85f9","Type":"ContainerStarted","Data":"e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a"} Jun 09 10:59:02.989347 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:02.989006 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b9df46f6-rhqk7" event={"ID":"25b56b53-6b5e-426b-b4c6-a9621c6a85f9","Type":"ContainerStarted","Data":"51b2faf52d43e44c364bbb5799a70f6209ebd363079d620f28a3118219c71802"} Jun 09 10:59:03.008706 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:03.008652 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85b9df46f6-rhqk7" podStartSLOduration=1.008634853 podStartE2EDuration="1.008634853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 10:59:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 10:59:03.007758165 +0000 UTC m=+321.541313245" watchObservedRunningTime="2026-06-09 10:59:03.008634853 +0000 UTC m=+321.542189934" Jun 09 10:59:03.255885 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:03.255852 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:03.875544 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:03.875507 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef767856-7f05-477a-99b0-c362681949eb" path="/var/lib/kubelet/pods/ef767856-7f05-477a-99b0-c362681949eb/volumes" Jun 09 10:59:06.998427 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:06.998394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:07.095294 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:07.095261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:12.574272 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:12.574235 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:12.574781 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:12.574293 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:12.578964 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:12.578937 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:13.030836 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:13.030809 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 10:59:13.078780 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:13.078746 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5758876596-j25mf"] Jun 09 10:59:13.287249 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:13.287174 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:13.389556 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:13.389523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:13.490481 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:13.490448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:18.046523 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:18.046485 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:18.102581 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:18.102548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:28.540235 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:28.540154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:28.640835 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:28.640800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 10:59:38.104193 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.104142 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5758876596-j25mf" podUID="5cd014c7-1097-47ae-a353-ecbf641aa16b" containerName="console" containerID="cri-o://de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030" gracePeriod=15 Jun 09 10:59:38.353166 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.353136 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529465 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-oauth-config\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529524 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-service-ca\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529557 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-oauth-serving-cert\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529679 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9dh4x\" (UniqueName: \"kubernetes.io/projected/5cd014c7-1097-47ae-a353-ecbf641aa16b-kube-api-access-9dh4x\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529722 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-serving-cert\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529755 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-trusted-ca-bundle\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.529785 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-config\") pod \"5cd014c7-1097-47ae-a353-ecbf641aa16b\" (UID: \"5cd014c7-1097-47ae-a353-ecbf641aa16b\") " Jun 09 10:59:38.530812 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.530434 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-config" (OuterVolumeSpecName: "console-config") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:38.534051 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.533838 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:38.534645 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.534581 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-service-ca" (OuterVolumeSpecName: "service-ca") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:38.534801 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.534769 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:38.534899 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.534880 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 10:59:38.536413 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.536393 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 10:59:38.536642 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.536623 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cd014c7-1097-47ae-a353-ecbf641aa16b-kube-api-access-9dh4x" (OuterVolumeSpecName: "kube-api-access-9dh4x") pod "5cd014c7-1097-47ae-a353-ecbf641aa16b" (UID: "5cd014c7-1097-47ae-a353-ecbf641aa16b"). InnerVolumeSpecName "kube-api-access-9dh4x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 10:59:38.631426 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631368 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9dh4x\" (UniqueName: \"kubernetes.io/projected/5cd014c7-1097-47ae-a353-ecbf641aa16b-kube-api-access-9dh4x\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:38.631426 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631418 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-serving-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:38.631426 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631428 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-trusted-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:38.631426 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631438 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:38.631426 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631446 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5cd014c7-1097-47ae-a353-ecbf641aa16b-console-oauth-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:38.631775 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631455 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-service-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:38.631775 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:38.631465 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5cd014c7-1097-47ae-a353-ecbf641aa16b-oauth-serving-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 10:59:39.125306 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.125265 2562 generic.go:356] "Generic (PLEG): container finished" podID="5cd014c7-1097-47ae-a353-ecbf641aa16b" containerID="de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030" exitCode=0 Jun 09 10:59:39.125808 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.125331 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5758876596-j25mf" Jun 09 10:59:39.125808 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.125335 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5758876596-j25mf" event={"ID":"5cd014c7-1097-47ae-a353-ecbf641aa16b","Type":"ContainerDied","Data":"de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030"} Jun 09 10:59:39.125808 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.125455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5758876596-j25mf" event={"ID":"5cd014c7-1097-47ae-a353-ecbf641aa16b","Type":"ContainerDied","Data":"a9ee69949891aa0c44dad8712484d0a5cc7f99fcecd6e5b1c370219673f6709e"} Jun 09 10:59:39.125808 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.125476 2562 scope.go:117] "RemoveContainer" containerID="de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030" Jun 09 10:59:39.134174 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.134156 2562 scope.go:117] "RemoveContainer" containerID="de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030" Jun 09 10:59:39.134418 ip-10-0-132-253 kubenswrapper[2562]: E0609 10:59:39.134401 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030\": container with ID starting with de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030 not found: ID does not exist" containerID="de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030" Jun 09 10:59:39.134475 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.134428 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030"} err="failed to get container status \"de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030\": rpc error: code = NotFound desc = could not find container \"de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030\": container with ID starting with de5a5eca6efe1bec5dab4f2d3d3482ceab053914b77ac0461bf0d6f7f0c2d030 not found: ID does not exist" Jun 09 10:59:39.146533 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.146502 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5758876596-j25mf"] Jun 09 10:59:39.150668 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.150636 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5758876596-j25mf"] Jun 09 10:59:39.874352 ip-10-0-132-253 kubenswrapper[2562]: I0609 10:59:39.874316 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5cd014c7-1097-47ae-a353-ecbf641aa16b" path="/var/lib/kubelet/pods/5cd014c7-1097-47ae-a353-ecbf641aa16b/volumes" Jun 09 11:00:09.734983 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:09.734947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:09.795712 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:09.795683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:13.357317 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:13.357278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:13.459721 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:13.459689 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:14.439727 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.439693 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9"] Jun 09 11:00:14.440116 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.439964 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cd014c7-1097-47ae-a353-ecbf641aa16b" containerName="console" Jun 09 11:00:14.440116 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.439975 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cd014c7-1097-47ae-a353-ecbf641aa16b" containerName="console" Jun 09 11:00:14.440116 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.440049 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cd014c7-1097-47ae-a353-ecbf641aa16b" containerName="console" Jun 09 11:00:14.443220 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.443198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.446594 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.446569 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 11:00:14.447845 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.447827 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7mxzp\"" Jun 09 11:00:14.447949 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.447868 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 11:00:14.452824 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.452804 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9"] Jun 09 11:00:14.505330 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.505294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.505520 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.505348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.505520 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.505374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mrdp\" (UniqueName: \"kubernetes.io/projected/75f66feb-3931-4370-a094-ccc3a7c971fd-kube-api-access-6mrdp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.606196 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.606165 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mrdp\" (UniqueName: \"kubernetes.io/projected/75f66feb-3931-4370-a094-ccc3a7c971fd-kube-api-access-6mrdp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.606299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.606229 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.606299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.606260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.606576 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.606560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.606651 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.606632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.614963 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.614939 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mrdp\" (UniqueName: \"kubernetes.io/projected/75f66feb-3931-4370-a094-ccc3a7c971fd-kube-api-access-6mrdp\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.752809 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.752774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:14.884978 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.884952 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9"] Jun 09 11:00:14.887131 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:00:14.887101 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f66feb_3931_4370_a094_ccc3a7c971fd.slice/crio-18b22806caa891f8b98ea12bbae20bf5ce2874510016625da2cc3fc1cea22fd1 WatchSource:0}: Error finding container 18b22806caa891f8b98ea12bbae20bf5ce2874510016625da2cc3fc1cea22fd1: Status 404 returned error can't find the container with id 18b22806caa891f8b98ea12bbae20bf5ce2874510016625da2cc3fc1cea22fd1 Jun 09 11:00:14.889058 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:14.889041 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:00:15.257479 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:15.257442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" event={"ID":"75f66feb-3931-4370-a094-ccc3a7c971fd","Type":"ContainerStarted","Data":"18b22806caa891f8b98ea12bbae20bf5ce2874510016625da2cc3fc1cea22fd1"} Jun 09 11:00:22.286765 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:22.286731 2562 generic.go:356] "Generic (PLEG): container finished" podID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerID="a2fe2b0c8aed32a0d62552794a093f518a71d58c0406800bcbdba7a70a442fdf" exitCode=0 Jun 09 11:00:22.287137 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:22.286781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" event={"ID":"75f66feb-3931-4370-a094-ccc3a7c971fd","Type":"ContainerDied","Data":"a2fe2b0c8aed32a0d62552794a093f518a71d58c0406800bcbdba7a70a442fdf"} Jun 09 11:00:25.304663 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:25.304613 2562 generic.go:356] "Generic (PLEG): container finished" podID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerID="d26d4e0a33821dca3c6d0ba9580aa8d0b8f844254c81d87dcaf00290c44ccbe8" exitCode=0 Jun 09 11:00:25.305162 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:25.304699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" event={"ID":"75f66feb-3931-4370-a094-ccc3a7c971fd","Type":"ContainerDied","Data":"d26d4e0a33821dca3c6d0ba9580aa8d0b8f844254c81d87dcaf00290c44ccbe8"} Jun 09 11:00:33.335307 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:33.335266 2562 generic.go:356] "Generic (PLEG): container finished" podID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerID="b407c73420d21578f5cc0138f7c0276e8e052b082390349a66c8ce16824de422" exitCode=0 Jun 09 11:00:33.335732 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:33.335312 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" event={"ID":"75f66feb-3931-4370-a094-ccc3a7c971fd","Type":"ContainerDied","Data":"b407c73420d21578f5cc0138f7c0276e8e052b082390349a66c8ce16824de422"} Jun 09 11:00:34.478190 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.478154 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:34.574062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.574015 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-util\") pod \"75f66feb-3931-4370-a094-ccc3a7c971fd\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " Jun 09 11:00:34.574267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.574090 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mrdp\" (UniqueName: \"kubernetes.io/projected/75f66feb-3931-4370-a094-ccc3a7c971fd-kube-api-access-6mrdp\") pod \"75f66feb-3931-4370-a094-ccc3a7c971fd\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " Jun 09 11:00:34.574267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.574142 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-bundle\") pod \"75f66feb-3931-4370-a094-ccc3a7c971fd\" (UID: \"75f66feb-3931-4370-a094-ccc3a7c971fd\") " Jun 09 11:00:34.574845 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.574808 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-bundle" (OuterVolumeSpecName: "bundle") pod "75f66feb-3931-4370-a094-ccc3a7c971fd" (UID: "75f66feb-3931-4370-a094-ccc3a7c971fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:00:34.576441 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.576413 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75f66feb-3931-4370-a094-ccc3a7c971fd-kube-api-access-6mrdp" (OuterVolumeSpecName: "kube-api-access-6mrdp") pod "75f66feb-3931-4370-a094-ccc3a7c971fd" (UID: "75f66feb-3931-4370-a094-ccc3a7c971fd"). InnerVolumeSpecName "kube-api-access-6mrdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:00:34.578207 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.578182 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-util" (OuterVolumeSpecName: "util") pod "75f66feb-3931-4370-a094-ccc3a7c971fd" (UID: "75f66feb-3931-4370-a094-ccc3a7c971fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:00:34.675077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.674981 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mrdp\" (UniqueName: \"kubernetes.io/projected/75f66feb-3931-4370-a094-ccc3a7c971fd-kube-api-access-6mrdp\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:00:34.675077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.675019 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:00:34.675077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:34.675028 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/75f66feb-3931-4370-a094-ccc3a7c971fd-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:00:35.343120 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:35.343091 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" Jun 09 11:00:35.343297 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:35.343081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dnfrs9" event={"ID":"75f66feb-3931-4370-a094-ccc3a7c971fd","Type":"ContainerDied","Data":"18b22806caa891f8b98ea12bbae20bf5ce2874510016625da2cc3fc1cea22fd1"} Jun 09 11:00:35.343297 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:35.343217 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18b22806caa891f8b98ea12bbae20bf5ce2874510016625da2cc3fc1cea22fd1" Jun 09 11:00:40.501513 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:40.501469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:41.284163 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:41.284127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:42.457326 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457291 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg"] Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457540 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="pull" Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457550 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="pull" Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457568 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="util" Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457574 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="util" Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457580 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="extract" Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457586 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="extract" Jun 09 11:00:42.457729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.457644 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="75f66feb-3931-4370-a094-ccc3a7c971fd" containerName="extract" Jun 09 11:00:42.461678 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.461659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.464814 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.464790 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4q78j\"" Jun 09 11:00:42.464942 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.464799 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:00:42.465142 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.465127 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 09 11:00:42.481488 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.481451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg"] Jun 09 11:00:42.645461 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.645414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr4dm\" (UniqueName: \"kubernetes.io/projected/b8404831-3728-4e4b-938b-21a9e16a516b-kube-api-access-sr4dm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5cppg\" (UID: \"b8404831-3728-4e4b-938b-21a9e16a516b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.645688 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.645478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8404831-3728-4e4b-938b-21a9e16a516b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5cppg\" (UID: \"b8404831-3728-4e4b-938b-21a9e16a516b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.746615 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.746574 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr4dm\" (UniqueName: \"kubernetes.io/projected/b8404831-3728-4e4b-938b-21a9e16a516b-kube-api-access-sr4dm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5cppg\" (UID: \"b8404831-3728-4e4b-938b-21a9e16a516b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.746795 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.746669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8404831-3728-4e4b-938b-21a9e16a516b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5cppg\" (UID: \"b8404831-3728-4e4b-938b-21a9e16a516b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.747096 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.747073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8404831-3728-4e4b-938b-21a9e16a516b-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5cppg\" (UID: \"b8404831-3728-4e4b-938b-21a9e16a516b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.759164 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.759131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr4dm\" (UniqueName: \"kubernetes.io/projected/b8404831-3728-4e4b-938b-21a9e16a516b-kube-api-access-sr4dm\") pod \"cert-manager-operator-controller-manager-57757f7cfc-5cppg\" (UID: \"b8404831-3728-4e4b-938b-21a9e16a516b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.770185 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.770148 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" Jun 09 11:00:42.904932 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:42.904837 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg"] Jun 09 11:00:42.908107 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:00:42.908073 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8404831_3728_4e4b_938b_21a9e16a516b.slice/crio-abb29e12d1edc3afcbf33fc97bea8833652de33a429d7af2f3719310283d48b0 WatchSource:0}: Error finding container abb29e12d1edc3afcbf33fc97bea8833652de33a429d7af2f3719310283d48b0: Status 404 returned error can't find the container with id abb29e12d1edc3afcbf33fc97bea8833652de33a429d7af2f3719310283d48b0 Jun 09 11:00:43.373769 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:43.373727 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" event={"ID":"b8404831-3728-4e4b-938b-21a9e16a516b","Type":"ContainerStarted","Data":"abb29e12d1edc3afcbf33fc97bea8833652de33a429d7af2f3719310283d48b0"} Jun 09 11:00:44.056437 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:44.056402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:44.157048 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:44.156976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:45.384273 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:45.384238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" event={"ID":"b8404831-3728-4e4b-938b-21a9e16a516b","Type":"ContainerStarted","Data":"cf3d46759d7febd2da361dcff5b289b8f1a75f03e315ed97c2a0053fd2e24b87"} Jun 09 11:00:45.408702 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:45.407291 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-5cppg" podStartSLOduration=1.5317960369999999 podStartE2EDuration="3.407268266s" totalImagesPullingTime="1.875472229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:00:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:00:45.40591214 +0000 UTC m=+423.939467222" watchObservedRunningTime="2026-06-09 11:00:45.407268266 +0000 UTC m=+423.940823347" Jun 09 11:00:45.575302 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:45.575265 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:45.671661 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:45.671548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:45.829610 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:45.829580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:45.940214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:45.940125 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:46.576043 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.576004 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x"] Jun 09 11:00:46.582170 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.582136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.585185 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.585162 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7mxzp\"" Jun 09 11:00:46.585270 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.585181 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 11:00:46.585270 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.585182 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 11:00:46.589418 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.589247 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x"] Jun 09 11:00:46.682790 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.682748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.682974 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.682799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkj4\" (UniqueName: \"kubernetes.io/projected/5c322e92-4b82-4330-ad19-f778273a59b9-kube-api-access-nzkj4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.682974 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.682896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.784140 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.784102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.784315 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.784151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.784315 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.784287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkj4\" (UniqueName: \"kubernetes.io/projected/5c322e92-4b82-4330-ad19-f778273a59b9-kube-api-access-nzkj4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.784576 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.784552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.784697 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.784588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.795411 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.795375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkj4\" (UniqueName: \"kubernetes.io/projected/5c322e92-4b82-4330-ad19-f778273a59b9-kube-api-access-nzkj4\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:46.892871 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:46.892777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:47.052618 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:47.052569 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x"] Jun 09 11:00:47.055591 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:00:47.055559 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c322e92_4b82_4330_ad19_f778273a59b9.slice/crio-13ad9decdb3c3e34d70d811b293c3788ce337cc62afd31b685e5716ec9bcb21b WatchSource:0}: Error finding container 13ad9decdb3c3e34d70d811b293c3788ce337cc62afd31b685e5716ec9bcb21b: Status 404 returned error can't find the container with id 13ad9decdb3c3e34d70d811b293c3788ce337cc62afd31b685e5716ec9bcb21b Jun 09 11:00:47.393827 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:47.393790 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c322e92-4b82-4330-ad19-f778273a59b9" containerID="a8ebd72e7cb918cf04335a7ff4a8a6e3392aa2e50b8d18fcd6069b7a92313e87" exitCode=0 Jun 09 11:00:47.394011 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:47.393846 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" event={"ID":"5c322e92-4b82-4330-ad19-f778273a59b9","Type":"ContainerDied","Data":"a8ebd72e7cb918cf04335a7ff4a8a6e3392aa2e50b8d18fcd6069b7a92313e87"} Jun 09 11:00:47.394011 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:47.393891 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" event={"ID":"5c322e92-4b82-4330-ad19-f778273a59b9","Type":"ContainerStarted","Data":"13ad9decdb3c3e34d70d811b293c3788ce337cc62afd31b685e5716ec9bcb21b"} Jun 09 11:00:48.878744 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:48.878712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:49.462589 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:49.462548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:50.260661 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.260594 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs"] Jun 09 11:00:50.264109 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.264090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.266868 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.266843 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 11:00:50.268052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.268030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7k98s\"" Jun 09 11:00:50.268139 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.268038 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 11:00:50.271721 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.271697 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs"] Jun 09 11:00:50.315294 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.315249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh45\" (UniqueName: \"kubernetes.io/projected/9ba81cf8-f4e2-4f48-871f-8f55582e1ad5-kube-api-access-kmh45\") pod \"cert-manager-webhook-7dc76cbb94-l9kbs\" (UID: \"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.315294 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.315297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ba81cf8-f4e2-4f48-871f-8f55582e1ad5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-l9kbs\" (UID: \"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.410032 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.409993 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c322e92-4b82-4330-ad19-f778273a59b9" containerID="b1c851f232e7d564c80e141a0e9bfbfc1ce81d36440b3689c0754a4aefa0419b" exitCode=0 Jun 09 11:00:50.410032 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.410027 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" event={"ID":"5c322e92-4b82-4330-ad19-f778273a59b9","Type":"ContainerDied","Data":"b1c851f232e7d564c80e141a0e9bfbfc1ce81d36440b3689c0754a4aefa0419b"} Jun 09 11:00:50.416127 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.416101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh45\" (UniqueName: \"kubernetes.io/projected/9ba81cf8-f4e2-4f48-871f-8f55582e1ad5-kube-api-access-kmh45\") pod \"cert-manager-webhook-7dc76cbb94-l9kbs\" (UID: \"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.416189 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.416141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ba81cf8-f4e2-4f48-871f-8f55582e1ad5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-l9kbs\" (UID: \"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.424800 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.424777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9ba81cf8-f4e2-4f48-871f-8f55582e1ad5-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-l9kbs\" (UID: \"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.424922 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.424902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh45\" (UniqueName: \"kubernetes.io/projected/9ba81cf8-f4e2-4f48-871f-8f55582e1ad5-kube-api-access-kmh45\") pod \"cert-manager-webhook-7dc76cbb94-l9kbs\" (UID: \"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.585770 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.585727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:50.721323 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.721298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs"] Jun 09 11:00:50.723840 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:00:50.723806 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ba81cf8_f4e2_4f48_871f_8f55582e1ad5.slice/crio-e64a5866c54bdad2ddbaad69ac291209a89d93abda5768bb9226a9925c0415fe WatchSource:0}: Error finding container e64a5866c54bdad2ddbaad69ac291209a89d93abda5768bb9226a9925c0415fe: Status 404 returned error can't find the container with id e64a5866c54bdad2ddbaad69ac291209a89d93abda5768bb9226a9925c0415fe Jun 09 11:00:50.862766 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.862661 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:50.962548 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:50.962506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:51.416112 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:51.416075 2562 generic.go:356] "Generic (PLEG): container finished" podID="5c322e92-4b82-4330-ad19-f778273a59b9" containerID="d3ef69b369486dd3b88982f4753775f44d453e0014b88233639922de1fb98d6f" exitCode=0 Jun 09 11:00:51.416533 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:51.416167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" event={"ID":"5c322e92-4b82-4330-ad19-f778273a59b9","Type":"ContainerDied","Data":"d3ef69b369486dd3b88982f4753775f44d453e0014b88233639922de1fb98d6f"} Jun 09 11:00:51.417350 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:51.417325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" event={"ID":"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5","Type":"ContainerStarted","Data":"e64a5866c54bdad2ddbaad69ac291209a89d93abda5768bb9226a9925c0415fe"} Jun 09 11:00:52.579630 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.579580 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:52.636475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.636435 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzkj4\" (UniqueName: \"kubernetes.io/projected/5c322e92-4b82-4330-ad19-f778273a59b9-kube-api-access-nzkj4\") pod \"5c322e92-4b82-4330-ad19-f778273a59b9\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " Jun 09 11:00:52.636475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.636481 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-bundle\") pod \"5c322e92-4b82-4330-ad19-f778273a59b9\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " Jun 09 11:00:52.636763 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.636512 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-util\") pod \"5c322e92-4b82-4330-ad19-f778273a59b9\" (UID: \"5c322e92-4b82-4330-ad19-f778273a59b9\") " Jun 09 11:00:52.637195 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.637163 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-bundle" (OuterVolumeSpecName: "bundle") pod "5c322e92-4b82-4330-ad19-f778273a59b9" (UID: "5c322e92-4b82-4330-ad19-f778273a59b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:00:52.639110 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.639080 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c322e92-4b82-4330-ad19-f778273a59b9-kube-api-access-nzkj4" (OuterVolumeSpecName: "kube-api-access-nzkj4") pod "5c322e92-4b82-4330-ad19-f778273a59b9" (UID: "5c322e92-4b82-4330-ad19-f778273a59b9"). InnerVolumeSpecName "kube-api-access-nzkj4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:00:52.642666 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.642629 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-util" (OuterVolumeSpecName: "util") pod "5c322e92-4b82-4330-ad19-f778273a59b9" (UID: "5c322e92-4b82-4330-ad19-f778273a59b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:00:52.737878 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.737828 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzkj4\" (UniqueName: \"kubernetes.io/projected/5c322e92-4b82-4330-ad19-f778273a59b9-kube-api-access-nzkj4\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:00:52.737878 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.737863 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:00:52.737878 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:52.737877 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5c322e92-4b82-4330-ad19-f778273a59b9-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:00:53.428973 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:53.428878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" event={"ID":"5c322e92-4b82-4330-ad19-f778273a59b9","Type":"ContainerDied","Data":"13ad9decdb3c3e34d70d811b293c3788ce337cc62afd31b685e5716ec9bcb21b"} Jun 09 11:00:53.428973 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:53.428916 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhr59x" Jun 09 11:00:53.428973 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:53.428947 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13ad9decdb3c3e34d70d811b293c3788ce337cc62afd31b685e5716ec9bcb21b" Jun 09 11:00:54.296883 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:54.296782 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:54.397461 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:54.397421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:54.434628 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:54.434570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" event={"ID":"9ba81cf8-f4e2-4f48-871f-8f55582e1ad5","Type":"ContainerStarted","Data":"cd45d658ac5ae6e354e2b83d582b85d085da1dbd81ad756f1c3429f19939d75c"} Jun 09 11:00:54.434818 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:54.434699 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:00:54.451893 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:54.451840 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" podStartSLOduration=1.146654526 podStartE2EDuration="4.451824503s" totalImagesPullingTime="3.305169977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:00:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:00:54.45130472 +0000 UTC m=+432.984859800" watchObservedRunningTime="2026-06-09 11:00:54.451824503 +0000 UTC m=+432.985379581" Jun 09 11:00:56.663267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:56.663218 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:56.762346 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:56.762315 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:00:57.289182 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:00:57.289141 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:00.441176 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:00.441144 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-l9kbs" Jun 09 11:01:04.091351 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:04.091313 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:04.191187 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:04.191146 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:04.370667 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:04.370576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:05.742516 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs"] Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742777 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="util" Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742788 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="util" Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742804 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="pull" Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742809 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="pull" Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742819 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="extract" Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742824 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="extract" Jun 09 11:01:05.742906 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.742870 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c322e92-4b82-4330-ad19-f778273a59b9" containerName="extract" Jun 09 11:01:05.789331 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.789293 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs"] Jun 09 11:01:05.789505 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.789419 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.792821 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.792798 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 11:01:05.792986 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.792878 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7mxzp\"" Jun 09 11:01:05.792986 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.792809 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 11:01:05.846783 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.846750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.846999 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.846796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.846999 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.846839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jk6n\" (UniqueName: \"kubernetes.io/projected/e2e4d88a-18cb-48bf-8508-97479359a9ac-kube-api-access-6jk6n\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.863594 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.863560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:05.948053 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.948006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.948252 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.948063 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.948252 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.948116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jk6n\" (UniqueName: \"kubernetes.io/projected/e2e4d88a-18cb-48bf-8508-97479359a9ac-kube-api-access-6jk6n\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.948443 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.948419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.948507 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.948438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:05.957687 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:05.957649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jk6n\" (UniqueName: \"kubernetes.io/projected/e2e4d88a-18cb-48bf-8508-97479359a9ac-kube-api-access-6jk6n\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:06.099730 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:06.099634 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:06.239593 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:06.239564 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs"] Jun 09 11:01:06.242151 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:01:06.242121 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e4d88a_18cb_48bf_8508_97479359a9ac.slice/crio-f6cafc5e046e8cebbb9b12688b42ab0b209dd496ba8bbdd638c83304d2b5c2cd WatchSource:0}: Error finding container f6cafc5e046e8cebbb9b12688b42ab0b209dd496ba8bbdd638c83304d2b5c2cd: Status 404 returned error can't find the container with id f6cafc5e046e8cebbb9b12688b42ab0b209dd496ba8bbdd638c83304d2b5c2cd Jun 09 11:01:06.484260 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:06.484221 2562 generic.go:356] "Generic (PLEG): container finished" podID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerID="6783fff0228d0d7df5c92c239f2b8371ab60991ddd797485dbdf6a28a17154da" exitCode=0 Jun 09 11:01:06.484435 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:06.484262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" event={"ID":"e2e4d88a-18cb-48bf-8508-97479359a9ac","Type":"ContainerDied","Data":"6783fff0228d0d7df5c92c239f2b8371ab60991ddd797485dbdf6a28a17154da"} Jun 09 11:01:06.484435 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:06.484317 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" event={"ID":"e2e4d88a-18cb-48bf-8508-97479359a9ac","Type":"ContainerStarted","Data":"f6cafc5e046e8cebbb9b12688b42ab0b209dd496ba8bbdd638c83304d2b5c2cd"} Jun 09 11:01:07.490484 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:07.490441 2562 generic.go:356] "Generic (PLEG): container finished" podID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerID="d809e75274d69e65648b10deb9cbdc5b0034fabd56869c4641e9972f1cbae37c" exitCode=0 Jun 09 11:01:07.490881 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:07.490534 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" event={"ID":"e2e4d88a-18cb-48bf-8508-97479359a9ac","Type":"ContainerDied","Data":"d809e75274d69e65648b10deb9cbdc5b0034fabd56869c4641e9972f1cbae37c"} Jun 09 11:01:08.496915 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:08.496884 2562 generic.go:356] "Generic (PLEG): container finished" podID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerID="cfbb18d49519055f5d56f60dba4498b6d293de595a4cea74d1ed369ce2eb9de3" exitCode=0 Jun 09 11:01:08.497364 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:08.496952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" event={"ID":"e2e4d88a-18cb-48bf-8508-97479359a9ac","Type":"ContainerDied","Data":"cfbb18d49519055f5d56f60dba4498b6d293de595a4cea74d1ed369ce2eb9de3"} Jun 09 11:01:09.629907 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.629872 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:09.681349 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.681308 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-bundle\") pod \"e2e4d88a-18cb-48bf-8508-97479359a9ac\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " Jun 09 11:01:09.681349 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.681347 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jk6n\" (UniqueName: \"kubernetes.io/projected/e2e4d88a-18cb-48bf-8508-97479359a9ac-kube-api-access-6jk6n\") pod \"e2e4d88a-18cb-48bf-8508-97479359a9ac\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " Jun 09 11:01:09.681626 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.681382 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-util\") pod \"e2e4d88a-18cb-48bf-8508-97479359a9ac\" (UID: \"e2e4d88a-18cb-48bf-8508-97479359a9ac\") " Jun 09 11:01:09.682085 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.682060 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-bundle" (OuterVolumeSpecName: "bundle") pod "e2e4d88a-18cb-48bf-8508-97479359a9ac" (UID: "e2e4d88a-18cb-48bf-8508-97479359a9ac"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:01:09.683634 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.683614 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e4d88a-18cb-48bf-8508-97479359a9ac-kube-api-access-6jk6n" (OuterVolumeSpecName: "kube-api-access-6jk6n") pod "e2e4d88a-18cb-48bf-8508-97479359a9ac" (UID: "e2e4d88a-18cb-48bf-8508-97479359a9ac"). InnerVolumeSpecName "kube-api-access-6jk6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:01:09.686879 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.686840 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-util" (OuterVolumeSpecName: "util") pod "e2e4d88a-18cb-48bf-8508-97479359a9ac" (UID: "e2e4d88a-18cb-48bf-8508-97479359a9ac"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:01:09.782478 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.782377 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:01:09.782478 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.782413 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2e4d88a-18cb-48bf-8508-97479359a9ac-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:01:09.782478 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:09.782422 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jk6n\" (UniqueName: \"kubernetes.io/projected/e2e4d88a-18cb-48bf-8508-97479359a9ac-kube-api-access-6jk6n\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:01:10.507351 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:10.507316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" event={"ID":"e2e4d88a-18cb-48bf-8508-97479359a9ac","Type":"ContainerDied","Data":"f6cafc5e046e8cebbb9b12688b42ab0b209dd496ba8bbdd638c83304d2b5c2cd"} Jun 09 11:01:10.507351 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:10.507342 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdnhrhs" Jun 09 11:01:10.507595 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:10.507365 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6cafc5e046e8cebbb9b12688b42ab0b209dd496ba8bbdd638c83304d2b5c2cd" Jun 09 11:01:16.469692 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:16.469648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:16.577637 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:16.577579 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:18.701076 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:18.701040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:18.825397 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:18.825360 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:19.283291 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.283255 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:19.520828 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.520790 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:19.619465 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.619380 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:19.662794 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.662759 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt"] Jun 09 11:01:19.663066 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663052 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="pull" Jun 09 11:01:19.663106 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663068 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="pull" Jun 09 11:01:19.663106 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663084 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="extract" Jun 09 11:01:19.663106 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663089 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="extract" Jun 09 11:01:19.663106 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663102 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="util" Jun 09 11:01:19.663106 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663107 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="util" Jun 09 11:01:19.663254 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.663150 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e4d88a-18cb-48bf-8508-97479359a9ac" containerName="extract" Jun 09 11:01:19.665147 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.665124 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.674656 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.674633 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 11:01:19.674840 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.674819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f88ll\"" Jun 09 11:01:19.674892 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.674842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 11:01:19.675101 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.675088 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 11:01:19.675268 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.675255 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 11:01:19.694043 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.694006 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt"] Jun 09 11:01:19.766165 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.766119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f144f0a-6e47-4703-a879-6149089f54bc-manifests\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.766633 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.766174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tw2l\" (UniqueName: \"kubernetes.io/projected/9f144f0a-6e47-4703-a879-6149089f54bc-kube-api-access-5tw2l\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.766633 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.766238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f144f0a-6e47-4703-a879-6149089f54bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.766633 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.766318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f144f0a-6e47-4703-a879-6149089f54bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.766633 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.766353 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f144f0a-6e47-4703-a879-6149089f54bc-tmp\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.867214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.867173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tw2l\" (UniqueName: \"kubernetes.io/projected/9f144f0a-6e47-4703-a879-6149089f54bc-kube-api-access-5tw2l\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.867214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.867219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f144f0a-6e47-4703-a879-6149089f54bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.867484 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.867265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f144f0a-6e47-4703-a879-6149089f54bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.867484 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.867287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f144f0a-6e47-4703-a879-6149089f54bc-tmp\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.867484 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.867313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f144f0a-6e47-4703-a879-6149089f54bc-manifests\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.867780 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.867755 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f144f0a-6e47-4703-a879-6149089f54bc-manifests\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.870012 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.869939 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f144f0a-6e47-4703-a879-6149089f54bc-tmp\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.870142 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.870123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f144f0a-6e47-4703-a879-6149089f54bc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.870189 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.870163 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f144f0a-6e47-4703-a879-6149089f54bc-webhook-cert\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.888825 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.888778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:19.894001 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.893972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tw2l\" (UniqueName: \"kubernetes.io/projected/9f144f0a-6e47-4703-a879-6149089f54bc-kube-api-access-5tw2l\") pod \"opendatahub-operator-controller-manager-d4c99d649-jd4mt\" (UID: \"9f144f0a-6e47-4703-a879-6149089f54bc\") " pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.975374 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.975330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:19.991428 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:19.991397 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:20.090349 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:20.090312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:20.119132 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:20.119104 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt"] Jun 09 11:01:20.121087 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:01:20.121031 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f144f0a_6e47_4703_a879_6149089f54bc.slice/crio-b2165d808643ea129a989e4aefad11f023049a04e5a0d2cec865f962a4e1b013 WatchSource:0}: Error finding container b2165d808643ea129a989e4aefad11f023049a04e5a0d2cec865f962a4e1b013: Status 404 returned error can't find the container with id b2165d808643ea129a989e4aefad11f023049a04e5a0d2cec865f962a4e1b013 Jun 09 11:01:20.190435 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:20.190400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:20.291304 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:20.291268 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:20.391412 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:20.391326 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:20.548956 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:20.548923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" event={"ID":"9f144f0a-6e47-4703-a879-6149089f54bc","Type":"ContainerStarted","Data":"b2165d808643ea129a989e4aefad11f023049a04e5a0d2cec865f962a4e1b013"} Jun 09 11:01:23.570193 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:23.570149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" event={"ID":"9f144f0a-6e47-4703-a879-6149089f54bc","Type":"ContainerStarted","Data":"af07437c1e6187bb4ddc90ddbc6a6372fd069a6c2b9ff376f832c5eb680483f6"} Jun 09 11:01:24.576168 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:24.576130 2562 generic.go:356] "Generic (PLEG): container finished" podID="9f144f0a-6e47-4703-a879-6149089f54bc" containerID="af07437c1e6187bb4ddc90ddbc6a6372fd069a6c2b9ff376f832c5eb680483f6" exitCode=0 Jun 09 11:01:24.576168 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:24.576168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" event={"ID":"9f144f0a-6e47-4703-a879-6149089f54bc","Type":"ContainerDied","Data":"af07437c1e6187bb4ddc90ddbc6a6372fd069a6c2b9ff376f832c5eb680483f6"} Jun 09 11:01:25.582482 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:25.582449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" event={"ID":"9f144f0a-6e47-4703-a879-6149089f54bc","Type":"ContainerStarted","Data":"ec0f6f68aa28d790c241562ba60330fa699c301702b299bdb0324ddc4c5a992d"} Jun 09 11:01:25.582909 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:25.582582 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:25.614146 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:25.614084 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" podStartSLOduration=2.047710754 podStartE2EDuration="6.614066805s" totalImagesPullingTime="3.502583901s" totalInitContainerRuntime="1.06377215s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:25.61085859 +0000 UTC m=+464.144413670" watchObservedRunningTime="2026-06-09 11:01:25.614066805 +0000 UTC m=+464.147621882" Jun 09 11:01:36.589768 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:36.589733 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d4c99d649-jd4mt" Jun 09 11:01:38.564824 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:38.564778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:38.709901 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:38.709847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:39.274026 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.273982 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tmr64"] Jun 09 11:01:39.283163 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.283134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.286903 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.286872 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 11:01:39.287194 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.287080 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-ltflj\"" Jun 09 11:01:39.287558 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.287533 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tmr64"] Jun 09 11:01:39.309616 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.309562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:39.334225 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.334188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a57bb5c4-16df-43ae-90a6-1b208f4b4860-cert\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.334437 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.334253 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cx59\" (UniqueName: \"kubernetes.io/projected/a57bb5c4-16df-43ae-90a6-1b208f4b4860-kube-api-access-2cx59\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.373579 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.373539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:39.435477 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.435435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cx59\" (UniqueName: \"kubernetes.io/projected/a57bb5c4-16df-43ae-90a6-1b208f4b4860-kube-api-access-2cx59\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.435706 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.435516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a57bb5c4-16df-43ae-90a6-1b208f4b4860-cert\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.435706 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:01:39.435666 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 11:01:39.435831 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:01:39.435732 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a57bb5c4-16df-43ae-90a6-1b208f4b4860-cert podName:a57bb5c4-16df-43ae-90a6-1b208f4b4860 nodeName:}" failed. No retries permitted until 2026-06-09 11:01:39.93571089 +0000 UTC m=+478.469265953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a57bb5c4-16df-43ae-90a6-1b208f4b4860-cert") pod "odh-model-controller-6dc94f689f-tmr64" (UID: "a57bb5c4-16df-43ae-90a6-1b208f4b4860") : secret "odh-model-controller-webhook-cert" not found Jun 09 11:01:39.450501 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.450469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cx59\" (UniqueName: \"kubernetes.io/projected/a57bb5c4-16df-43ae-90a6-1b208f4b4860-kube-api-access-2cx59\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.727072 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.727017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:39.830623 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.830570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:39.851558 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.851521 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-w4lrc"] Jun 09 11:01:39.854445 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.854427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:39.857493 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.857464 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dwg77\"" Jun 09 11:01:39.858168 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.858149 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 11:01:39.868769 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.868746 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-w4lrc"] Jun 09 11:01:39.938693 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.938642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a07ea475-389c-4ee6-bd4f-68e20e64ad40-tls-certs\") pod \"model-serving-api-5dd488fc48-w4lrc\" (UID: \"a07ea475-389c-4ee6-bd4f-68e20e64ad40\") " pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:39.938915 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.938759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a57bb5c4-16df-43ae-90a6-1b208f4b4860-cert\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:39.938915 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.938803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx28k\" (UniqueName: \"kubernetes.io/projected/a07ea475-389c-4ee6-bd4f-68e20e64ad40-kube-api-access-lx28k\") pod \"model-serving-api-5dd488fc48-w4lrc\" (UID: \"a07ea475-389c-4ee6-bd4f-68e20e64ad40\") " pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:39.941421 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:39.941399 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a57bb5c4-16df-43ae-90a6-1b208f4b4860-cert\") pod \"odh-model-controller-6dc94f689f-tmr64\" (UID: \"a57bb5c4-16df-43ae-90a6-1b208f4b4860\") " pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:40.039236 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.039145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx28k\" (UniqueName: \"kubernetes.io/projected/a07ea475-389c-4ee6-bd4f-68e20e64ad40-kube-api-access-lx28k\") pod \"model-serving-api-5dd488fc48-w4lrc\" (UID: \"a07ea475-389c-4ee6-bd4f-68e20e64ad40\") " pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:40.039398 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.039241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a07ea475-389c-4ee6-bd4f-68e20e64ad40-tls-certs\") pod \"model-serving-api-5dd488fc48-w4lrc\" (UID: \"a07ea475-389c-4ee6-bd4f-68e20e64ad40\") " pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:40.042010 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.041989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a07ea475-389c-4ee6-bd4f-68e20e64ad40-tls-certs\") pod \"model-serving-api-5dd488fc48-w4lrc\" (UID: \"a07ea475-389c-4ee6-bd4f-68e20e64ad40\") " pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:40.048079 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.048041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx28k\" (UniqueName: \"kubernetes.io/projected/a07ea475-389c-4ee6-bd4f-68e20e64ad40-kube-api-access-lx28k\") pod \"model-serving-api-5dd488fc48-w4lrc\" (UID: \"a07ea475-389c-4ee6-bd4f-68e20e64ad40\") " pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:40.080535 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.080505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:40.165234 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.165180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:40.196545 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.196498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:40.325315 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.324487 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-w4lrc"] Jun 09 11:01:40.342718 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.342675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:40.355855 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.355830 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tmr64"] Jun 09 11:01:40.357526 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:01:40.357497 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57bb5c4_16df_43ae_90a6_1b208f4b4860.slice/crio-551615062fb2e4d48ff90500057d41074ca6f316d29507ef9e0376a9d8c4ff48 WatchSource:0}: Error finding container 551615062fb2e4d48ff90500057d41074ca6f316d29507ef9e0376a9d8c4ff48: Status 404 returned error can't find the container with id 551615062fb2e4d48ff90500057d41074ca6f316d29507ef9e0376a9d8c4ff48 Jun 09 11:01:40.506472 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.506435 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp"] Jun 09 11:01:40.510278 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.510253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.514840 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.514817 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:01:40.514975 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.514817 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 11:01:40.516407 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.516376 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-shjnt\"" Jun 09 11:01:40.516552 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.516418 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 11:01:40.516552 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.516427 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 11:01:40.516552 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.516475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 11:01:40.523582 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.523556 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:40.534925 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.534897 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp"] Jun 09 11:01:40.542517 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.542447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3913e681-66ca-484e-8f47-457068cfeb0f-metrics-cert\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.542517 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.542503 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3913e681-66ca-484e-8f47-457068cfeb0f-cert\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.542723 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.542554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3913e681-66ca-484e-8f47-457068cfeb0f-manager-config\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.542723 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.542647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frg5f\" (UniqueName: \"kubernetes.io/projected/3913e681-66ca-484e-8f47-457068cfeb0f-kube-api-access-frg5f\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.643291 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.643253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3913e681-66ca-484e-8f47-457068cfeb0f-manager-config\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.643482 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.643312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frg5f\" (UniqueName: \"kubernetes.io/projected/3913e681-66ca-484e-8f47-457068cfeb0f-kube-api-access-frg5f\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.643482 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.643343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3913e681-66ca-484e-8f47-457068cfeb0f-metrics-cert\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.643482 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.643373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3913e681-66ca-484e-8f47-457068cfeb0f-cert\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.644078 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.644046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3913e681-66ca-484e-8f47-457068cfeb0f-manager-config\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.645973 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.645951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3913e681-66ca-484e-8f47-457068cfeb0f-metrics-cert\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.646258 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.646235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3913e681-66ca-484e-8f47-457068cfeb0f-cert\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.653595 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.653561 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" event={"ID":"a07ea475-389c-4ee6-bd4f-68e20e64ad40","Type":"ContainerStarted","Data":"e1782fd25c53b75443cf60ea816ca156900649bbba9a347bf8399226c0d00c00"} Jun 09 11:01:40.654157 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.654132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frg5f\" (UniqueName: \"kubernetes.io/projected/3913e681-66ca-484e-8f47-457068cfeb0f-kube-api-access-frg5f\") pod \"lws-controller-manager-7fd99f789d-2vgnp\" (UID: \"3913e681-66ca-484e-8f47-457068cfeb0f\") " pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.655032 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.655010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" event={"ID":"a57bb5c4-16df-43ae-90a6-1b208f4b4860","Type":"ContainerStarted","Data":"551615062fb2e4d48ff90500057d41074ca6f316d29507ef9e0376a9d8c4ff48"} Jun 09 11:01:40.820756 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.820641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:40.963383 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:40.963349 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp"] Jun 09 11:01:40.967709 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:01:40.967673 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3913e681_66ca_484e_8f47_457068cfeb0f.slice/crio-a0d41359186e755a95e330d947c176b8a92f6903917fed8088f37e21b6edff11 WatchSource:0}: Error finding container a0d41359186e755a95e330d947c176b8a92f6903917fed8088f37e21b6edff11: Status 404 returned error can't find the container with id a0d41359186e755a95e330d947c176b8a92f6903917fed8088f37e21b6edff11 Jun 09 11:01:41.664880 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:41.664511 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" event={"ID":"3913e681-66ca-484e-8f47-457068cfeb0f","Type":"ContainerStarted","Data":"a0d41359186e755a95e330d947c176b8a92f6903917fed8088f37e21b6edff11"} Jun 09 11:01:44.382576 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.382530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:44.482347 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.482312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:44.535100 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.535015 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp"] Jun 09 11:01:44.542561 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.540275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.546458 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.546428 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7mxzp\"" Jun 09 11:01:44.546629 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.546522 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 11:01:44.546766 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.546748 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 11:01:44.547469 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.547440 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp"] Jun 09 11:01:44.554930 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.554896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:44.580992 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.580792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.580992 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.580845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.580992 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.580881 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9sv\" (UniqueName: \"kubernetes.io/projected/c1f53a61-58a5-4784-a8ec-0f266da347c6-kube-api-access-tt9sv\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.681627 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.681580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.681797 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.681644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.681797 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.681669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9sv\" (UniqueName: \"kubernetes.io/projected/c1f53a61-58a5-4784-a8ec-0f266da347c6-kube-api-access-tt9sv\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.681931 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.681911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.682031 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.682000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.691525 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.691454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9sv\" (UniqueName: \"kubernetes.io/projected/c1f53a61-58a5-4784-a8ec-0f266da347c6-kube-api-access-tt9sv\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.855217 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.855179 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:44.962274 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:44.962157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:45.004793 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.004757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp"] Jun 09 11:01:45.006309 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:01:45.006281 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1f53a61_58a5_4784_a8ec_0f266da347c6.slice/crio-36c741cfb9e2f36646da1d05825abd88f39ecd5bcc84750619f98dc23bfdeb20 WatchSource:0}: Error finding container 36c741cfb9e2f36646da1d05825abd88f39ecd5bcc84750619f98dc23bfdeb20: Status 404 returned error can't find the container with id 36c741cfb9e2f36646da1d05825abd88f39ecd5bcc84750619f98dc23bfdeb20 Jun 09 11:01:45.686264 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.686234 2562 generic.go:356] "Generic (PLEG): container finished" podID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerID="e3d9b7bd96c629a2915bfdc72f88ed32aff7c619d4362189723926e791555840" exitCode=0 Jun 09 11:01:45.686751 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.686339 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" event={"ID":"c1f53a61-58a5-4784-a8ec-0f266da347c6","Type":"ContainerDied","Data":"e3d9b7bd96c629a2915bfdc72f88ed32aff7c619d4362189723926e791555840"} Jun 09 11:01:45.686751 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.686404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" event={"ID":"c1f53a61-58a5-4784-a8ec-0f266da347c6","Type":"ContainerStarted","Data":"36c741cfb9e2f36646da1d05825abd88f39ecd5bcc84750619f98dc23bfdeb20"} Jun 09 11:01:45.688103 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.688075 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" event={"ID":"a07ea475-389c-4ee6-bd4f-68e20e64ad40","Type":"ContainerStarted","Data":"df059d5820051aa3a489fe6ad53bbec82e272ba83f6cd1a227f3f41682bab393"} Jun 09 11:01:45.688211 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.688200 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:45.689683 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.689663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" event={"ID":"3913e681-66ca-484e-8f47-457068cfeb0f","Type":"ContainerStarted","Data":"ae151011047046193b4059fcdd3158d8d54b3644deb9643916e4c6323bf1fc3a"} Jun 09 11:01:45.689790 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.689724 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:45.691034 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.691013 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" event={"ID":"a57bb5c4-16df-43ae-90a6-1b208f4b4860","Type":"ContainerStarted","Data":"59068042ba2429b7ee927eacc07143f1b6f3006df95b479908f8a6902e72a1a3"} Jun 09 11:01:45.691145 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.691128 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:45.762160 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.762103 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" podStartSLOduration=2.473912364 podStartE2EDuration="6.762084836s" totalImagesPullingTime="4.288172472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:45.760239131 +0000 UTC m=+484.293794209" watchObservedRunningTime="2026-06-09 11:01:45.762084836 +0000 UTC m=+484.295639915" Jun 09 11:01:45.783739 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.783688 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" podStartSLOduration=2.857420611 podStartE2EDuration="6.783673413s" totalImagesPullingTime="3.926252802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:45.782826131 +0000 UTC m=+484.316381209" watchObservedRunningTime="2026-06-09 11:01:45.783673413 +0000 UTC m=+484.317228492" Jun 09 11:01:45.804230 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:45.804173 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" podStartSLOduration=2.045953306 podStartE2EDuration="5.804155589s" totalImagesPullingTime="3.758202283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:01:45.802810014 +0000 UTC m=+484.336365093" watchObservedRunningTime="2026-06-09 11:01:45.804155589 +0000 UTC m=+484.337710741" Jun 09 11:01:47.702233 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:47.702195 2562 generic.go:356] "Generic (PLEG): container finished" podID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerID="69f2e78c0bbad9bcd28aafb4fc3d8c2b7367a2e944391b909127e7d34ab6e838" exitCode=0 Jun 09 11:01:47.702740 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:47.702277 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" event={"ID":"c1f53a61-58a5-4784-a8ec-0f266da347c6","Type":"ContainerDied","Data":"69f2e78c0bbad9bcd28aafb4fc3d8c2b7367a2e944391b909127e7d34ab6e838"} Jun 09 11:01:48.045209 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:48.045170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:48.145231 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:48.145175 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:48.709192 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:48.709158 2562 generic.go:356] "Generic (PLEG): container finished" podID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerID="fe94d0978a29ab7de5a7cb5c19b424e62d425fb694b12a594712bd5ed7a0f679" exitCode=0 Jun 09 11:01:48.709627 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:48.709238 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" event={"ID":"c1f53a61-58a5-4784-a8ec-0f266da347c6","Type":"ContainerDied","Data":"fe94d0978a29ab7de5a7cb5c19b424e62d425fb694b12a594712bd5ed7a0f679"} Jun 09 11:01:49.430310 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.430260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:49.574161 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.574128 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:49.663441 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.663403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:49.844614 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.844573 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:49.929432 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.929403 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-util\") pod \"c1f53a61-58a5-4784-a8ec-0f266da347c6\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " Jun 09 11:01:49.929662 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.929465 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-bundle\") pod \"c1f53a61-58a5-4784-a8ec-0f266da347c6\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " Jun 09 11:01:49.929662 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.929502 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tt9sv\" (UniqueName: \"kubernetes.io/projected/c1f53a61-58a5-4784-a8ec-0f266da347c6-kube-api-access-tt9sv\") pod \"c1f53a61-58a5-4784-a8ec-0f266da347c6\" (UID: \"c1f53a61-58a5-4784-a8ec-0f266da347c6\") " Jun 09 11:01:49.930403 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.930374 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-bundle" (OuterVolumeSpecName: "bundle") pod "c1f53a61-58a5-4784-a8ec-0f266da347c6" (UID: "c1f53a61-58a5-4784-a8ec-0f266da347c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:01:49.931809 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.931784 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1f53a61-58a5-4784-a8ec-0f266da347c6-kube-api-access-tt9sv" (OuterVolumeSpecName: "kube-api-access-tt9sv") pod "c1f53a61-58a5-4784-a8ec-0f266da347c6" (UID: "c1f53a61-58a5-4784-a8ec-0f266da347c6"). InnerVolumeSpecName "kube-api-access-tt9sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:01:49.934937 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.934911 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-util" (OuterVolumeSpecName: "util") pod "c1f53a61-58a5-4784-a8ec-0f266da347c6" (UID: "c1f53a61-58a5-4784-a8ec-0f266da347c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:01:49.957267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:49.957233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:50.030096 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.030061 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:01:50.030096 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.030093 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tt9sv\" (UniqueName: \"kubernetes.io/projected/c1f53a61-58a5-4784-a8ec-0f266da347c6-kube-api-access-tt9sv\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:01:50.030096 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.030106 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1f53a61-58a5-4784-a8ec-0f266da347c6-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:01:50.234214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.234177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:50.351902 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.351809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:50.721168 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.721139 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" Jun 09 11:01:50.721168 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.721151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06fqkqp" event={"ID":"c1f53a61-58a5-4784-a8ec-0f266da347c6","Type":"ContainerDied","Data":"36c741cfb9e2f36646da1d05825abd88f39ecd5bcc84750619f98dc23bfdeb20"} Jun 09 11:01:50.721390 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.721198 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36c741cfb9e2f36646da1d05825abd88f39ecd5bcc84750619f98dc23bfdeb20" Jun 09 11:01:50.772793 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.772757 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:50.878763 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:50.878723 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:56.698093 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:56.698044 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-tmr64" Jun 09 11:01:56.698532 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:56.698219 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7fd99f789d-2vgnp" Jun 09 11:01:56.700529 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:56.700510 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-w4lrc" Jun 09 11:01:57.374722 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:57.374685 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:57.520179 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:57.520134 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:58.496682 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496631 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f"] Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496936 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="extract" Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496947 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="extract" Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496961 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="util" Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496966 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="util" Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496972 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="pull" Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.496978 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="pull" Jun 09 11:01:58.497074 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.497027 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1f53a61-58a5-4784-a8ec-0f266da347c6" containerName="extract" Jun 09 11:01:58.500047 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.500029 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.511331 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.511297 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 11:01:58.512034 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.512016 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7mxzp\"" Jun 09 11:01:58.517670 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.517649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 11:01:58.524374 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.524345 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f"] Jun 09 11:01:58.604899 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.604860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.605097 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.604946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.605097 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.604966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjq4h\" (UniqueName: \"kubernetes.io/projected/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-kube-api-access-xjq4h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.705783 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.705748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.705783 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.705789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjq4h\" (UniqueName: \"kubernetes.io/projected/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-kube-api-access-xjq4h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.706011 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.705833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.706154 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.706134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.706194 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.706166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.735689 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.735655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjq4h\" (UniqueName: \"kubernetes.io/projected/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-kube-api-access-xjq4h\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.808870 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.808777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:01:58.983090 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:01:58.983046 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c1b38e_9e69_4a15_9fcf_37e195aa8e47.slice/crio-077364fb4f213e522fb519a4f2252279e37454a0007487c2d2182b7cfe939ced WatchSource:0}: Error finding container 077364fb4f213e522fb519a4f2252279e37454a0007487c2d2182b7cfe939ced: Status 404 returned error can't find the container with id 077364fb4f213e522fb519a4f2252279e37454a0007487c2d2182b7cfe939ced Jun 09 11:01:58.984846 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:58.984809 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f"] Jun 09 11:01:59.119131 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:59.119102 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:59.245188 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:59.245150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:01:59.766360 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:59.766329 2562 generic.go:356] "Generic (PLEG): container finished" podID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerID="9ef8385f06a7f672826678061ade12fc6912de6235a0b5269197207c50d4b38a" exitCode=0 Jun 09 11:01:59.766756 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:59.766400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" event={"ID":"12c1b38e-9e69-4a15-9fcf-37e195aa8e47","Type":"ContainerDied","Data":"9ef8385f06a7f672826678061ade12fc6912de6235a0b5269197207c50d4b38a"} Jun 09 11:01:59.766756 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:59.766442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" event={"ID":"12c1b38e-9e69-4a15-9fcf-37e195aa8e47","Type":"ContainerStarted","Data":"077364fb4f213e522fb519a4f2252279e37454a0007487c2d2182b7cfe939ced"} Jun 09 11:01:59.829774 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:01:59.829733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:00.115491 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:00.115407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:00.773218 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:00.773125 2562 generic.go:356] "Generic (PLEG): container finished" podID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerID="31042b47633bda1877940527221cabd1c5ad6a580ac0d11b2a017ee6d4d62d71" exitCode=0 Jun 09 11:02:00.773576 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:00.773208 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" event={"ID":"12c1b38e-9e69-4a15-9fcf-37e195aa8e47","Type":"ContainerDied","Data":"31042b47633bda1877940527221cabd1c5ad6a580ac0d11b2a017ee6d4d62d71"} Jun 09 11:02:01.305764 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.305727 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-86df8c8b8b-tx8qn"] Jun 09 11:02:01.309021 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.308995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.314782 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.314751 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6px7z\"" Jun 09 11:02:01.315743 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.315702 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 11:02:01.321787 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.321756 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86df8c8b8b-tx8qn"] Jun 09 11:02:01.339910 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.339860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:01.430867 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.430821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l22qf\" (UniqueName: \"kubernetes.io/projected/e55c90a8-dd15-40fb-aa04-1a21f14b8fd0-kube-api-access-l22qf\") pod \"dashboard-redirect-86df8c8b8b-tx8qn\" (UID: \"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0\") " pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.431049 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.430896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e55c90a8-dd15-40fb-aa04-1a21f14b8fd0-redirect-config\") pod \"dashboard-redirect-86df8c8b8b-tx8qn\" (UID: \"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0\") " pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.531691 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.531646 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l22qf\" (UniqueName: \"kubernetes.io/projected/e55c90a8-dd15-40fb-aa04-1a21f14b8fd0-kube-api-access-l22qf\") pod \"dashboard-redirect-86df8c8b8b-tx8qn\" (UID: \"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0\") " pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.531857 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.531717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e55c90a8-dd15-40fb-aa04-1a21f14b8fd0-redirect-config\") pod \"dashboard-redirect-86df8c8b8b-tx8qn\" (UID: \"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0\") " pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.532386 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.532362 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/e55c90a8-dd15-40fb-aa04-1a21f14b8fd0-redirect-config\") pod \"dashboard-redirect-86df8c8b8b-tx8qn\" (UID: \"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0\") " pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.548482 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.548447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l22qf\" (UniqueName: \"kubernetes.io/projected/e55c90a8-dd15-40fb-aa04-1a21f14b8fd0-kube-api-access-l22qf\") pod \"dashboard-redirect-86df8c8b8b-tx8qn\" (UID: \"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0\") " pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.581647 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.581533 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:01.620709 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.620669 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" Jun 09 11:02:01.765954 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.765929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-86df8c8b8b-tx8qn"] Jun 09 11:02:01.767740 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:01.767713 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55c90a8_dd15_40fb_aa04_1a21f14b8fd0.slice/crio-173a9784c518ce6e51e517ba5f6b5199169acb1c8855f2fa82a53d07b8fef049 WatchSource:0}: Error finding container 173a9784c518ce6e51e517ba5f6b5199169acb1c8855f2fa82a53d07b8fef049: Status 404 returned error can't find the container with id 173a9784c518ce6e51e517ba5f6b5199169acb1c8855f2fa82a53d07b8fef049 Jun 09 11:02:01.778662 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.778631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" event={"ID":"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0","Type":"ContainerStarted","Data":"173a9784c518ce6e51e517ba5f6b5199169acb1c8855f2fa82a53d07b8fef049"} Jun 09 11:02:01.780741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.780716 2562 generic.go:356] "Generic (PLEG): container finished" podID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerID="ce6c866426e5c22bfd8a66c681426446a7f131af2ffa48b08febc88c689f502c" exitCode=0 Jun 09 11:02:01.780847 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:01.780758 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" event={"ID":"12c1b38e-9e69-4a15-9fcf-37e195aa8e47","Type":"ContainerDied","Data":"ce6c866426e5c22bfd8a66c681426446a7f131af2ffa48b08febc88c689f502c"} Jun 09 11:02:03.241400 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.241371 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:02:03.347991 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.347959 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-bundle\") pod \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " Jun 09 11:02:03.347991 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.348011 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-util\") pod \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " Jun 09 11:02:03.348238 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.348041 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjq4h\" (UniqueName: \"kubernetes.io/projected/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-kube-api-access-xjq4h\") pod \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\" (UID: \"12c1b38e-9e69-4a15-9fcf-37e195aa8e47\") " Jun 09 11:02:03.349082 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.349049 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-bundle" (OuterVolumeSpecName: "bundle") pod "12c1b38e-9e69-4a15-9fcf-37e195aa8e47" (UID: "12c1b38e-9e69-4a15-9fcf-37e195aa8e47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:02:03.351119 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.351085 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-kube-api-access-xjq4h" (OuterVolumeSpecName: "kube-api-access-xjq4h") pod "12c1b38e-9e69-4a15-9fcf-37e195aa8e47" (UID: "12c1b38e-9e69-4a15-9fcf-37e195aa8e47"). InnerVolumeSpecName "kube-api-access-xjq4h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:02:03.354523 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.354494 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-util" (OuterVolumeSpecName: "util") pod "12c1b38e-9e69-4a15-9fcf-37e195aa8e47" (UID: "12c1b38e-9e69-4a15-9fcf-37e195aa8e47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:02:03.449528 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.449493 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:02:03.449528 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.449528 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:02:03.449741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.449543 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjq4h\" (UniqueName: \"kubernetes.io/projected/12c1b38e-9e69-4a15-9fcf-37e195aa8e47-kube-api-access-xjq4h\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:02:03.793620 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.793551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" event={"ID":"e55c90a8-dd15-40fb-aa04-1a21f14b8fd0","Type":"ContainerStarted","Data":"a69de28b79c495923ef5dec0de442a066c3457332ce8a95f03de9ac29fd10df9"} Jun 09 11:02:03.795585 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.795551 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" event={"ID":"12c1b38e-9e69-4a15-9fcf-37e195aa8e47","Type":"ContainerDied","Data":"077364fb4f213e522fb519a4f2252279e37454a0007487c2d2182b7cfe939ced"} Jun 09 11:02:03.795719 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.795639 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="077364fb4f213e522fb519a4f2252279e37454a0007487c2d2182b7cfe939ced" Jun 09 11:02:03.795719 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.795565 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762acsz9f" Jun 09 11:02:03.825921 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:03.825858 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-86df8c8b8b-tx8qn" podStartSLOduration=0.897777383 podStartE2EDuration="2.825842089s" totalImagesPullingTime="1.928064706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:02:03.825703347 +0000 UTC m=+502.359258428" watchObservedRunningTime="2026-06-09 11:02:03.825842089 +0000 UTC m=+502.359397168" Jun 09 11:02:11.980687 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:11.980631 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:12.074570 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:12.074531 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:15.001299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:15.001252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:16.611848 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:16.611805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:16.710664 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:16.710624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:17.229977 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:17.229937 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:17.327090 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:17.327052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:21.057163 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.057132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:21.331654 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.331512 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5"] Jun 09 11:02:21.332018 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.331997 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="pull" Jun 09 11:02:21.332113 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.332021 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="pull" Jun 09 11:02:21.332113 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.332039 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="util" Jun 09 11:02:21.332113 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.332048 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="util" Jun 09 11:02:21.332113 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.332070 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="extract" Jun 09 11:02:21.332113 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.332079 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="extract" Jun 09 11:02:21.332391 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.332164 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c1b38e-9e69-4a15-9fcf-37e195aa8e47" containerName="extract" Jun 09 11:02:21.341737 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.341705 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.344951 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.344918 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 11:02:21.345132 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.344946 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kxh89\"" Jun 09 11:02:21.347784 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.347753 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5"] Jun 09 11:02:21.513363 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513568 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513568 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513461 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513568 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513568 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513755 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513755 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md76v\" (UniqueName: \"kubernetes.io/projected/635127a6-8601-4d8b-b72c-793f7ffe972c-kube-api-access-md76v\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513755 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.513755 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.513682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635127a6-8601-4d8b-b72c-793f7ffe972c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.614830 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.614717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.614830 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.614768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635127a6-8601-4d8b-b72c-793f7ffe972c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.614881 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.614941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.614974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615315 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615372 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615428 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615396 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615485 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md76v\" (UniqueName: \"kubernetes.io/projected/635127a6-8601-4d8b-b72c-793f7ffe972c-kube-api-access-md76v\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615546 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615743 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/635127a6-8601-4d8b-b72c-793f7ffe972c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.615875 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.615771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.617501 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.617478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.617900 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.617878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.626833 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.626798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/635127a6-8601-4d8b-b72c-793f7ffe972c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.626991 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.626837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md76v\" (UniqueName: \"kubernetes.io/projected/635127a6-8601-4d8b-b72c-793f7ffe972c-kube-api-access-md76v\") pod \"data-science-gateway-data-science-gateway-class-74759f9795tfdd5\" (UID: \"635127a6-8601-4d8b-b72c-793f7ffe972c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.657623 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.657552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:21.810357 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.810326 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5"] Jun 09 11:02:21.811450 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:21.811415 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod635127a6_8601_4d8b_b72c_793f7ffe972c.slice/crio-c9d4d21300949f19bca8027f645e65dd99f4f014b98c3f47d1fa7e7ccce3b793 WatchSource:0}: Error finding container c9d4d21300949f19bca8027f645e65dd99f4f014b98c3f47d1fa7e7ccce3b793: Status 404 returned error can't find the container with id c9d4d21300949f19bca8027f645e65dd99f4f014b98c3f47d1fa7e7ccce3b793 Jun 09 11:02:21.880156 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:21.880060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" event={"ID":"635127a6-8601-4d8b-b72c-793f7ffe972c","Type":"ContainerStarted","Data":"c9d4d21300949f19bca8027f645e65dd99f4f014b98c3f47d1fa7e7ccce3b793"} Jun 09 11:02:22.207615 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:22.207510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:25.121043 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:25.121001 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:02:25.121303 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:25.121087 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:02:25.121303 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:25.121116 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:02:25.904273 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:25.904235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" event={"ID":"635127a6-8601-4d8b-b72c-793f7ffe972c","Type":"ContainerStarted","Data":"288e931ca90caf20831fd8a435a4e3fd6dc28d82b5282f83dc22f81913b0150b"} Jun 09 11:02:25.937273 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:25.937213 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" podStartSLOduration=1.629970082 podStartE2EDuration="4.937195606s" totalImagesPullingTime="3.307225524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:02:25.93511567 +0000 UTC m=+524.468670750" watchObservedRunningTime="2026-06-09 11:02:25.937195606 +0000 UTC m=+524.470750685" Jun 09 11:02:26.150090 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:26.150018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:26.658689 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:26.658645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:26.663460 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:26.663433 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:26.909290 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:26.909213 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:26.910295 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:26.910276 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795tfdd5" Jun 09 11:02:40.254902 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.254857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:40.346309 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.346278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:40.381857 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.381823 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgf6g"] Jun 09 11:02:40.389339 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.389308 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:40.397718 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.397674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rh5hk\"" Jun 09 11:02:40.401228 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.401201 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 11:02:40.401366 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.401199 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 11:02:40.403287 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.403267 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgf6g"] Jun 09 11:02:40.421048 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.421020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:40.484317 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.484269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7thx\" (UniqueName: \"kubernetes.io/projected/1035e925-2694-4421-95bc-df46f8392a07-kube-api-access-v7thx\") pod \"kuadrant-operator-catalog-jgf6g\" (UID: \"1035e925-2694-4421-95bc-df46f8392a07\") " pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:40.585680 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.585557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7thx\" (UniqueName: \"kubernetes.io/projected/1035e925-2694-4421-95bc-df46f8392a07-kube-api-access-v7thx\") pod \"kuadrant-operator-catalog-jgf6g\" (UID: \"1035e925-2694-4421-95bc-df46f8392a07\") " pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:40.597999 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.597961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7thx\" (UniqueName: \"kubernetes.io/projected/1035e925-2694-4421-95bc-df46f8392a07-kube-api-access-v7thx\") pod \"kuadrant-operator-catalog-jgf6g\" (UID: \"1035e925-2694-4421-95bc-df46f8392a07\") " pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:40.701317 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.701275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:40.742023 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.741977 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgf6g"] Jun 09 11:02:40.845665 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:40.845633 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1035e925_2694_4421_95bc_df46f8392a07.slice/crio-0b5a435231d5b5fd9e591b209566e1157f5dea20984ae118b02ab00ee0f080ec WatchSource:0}: Error finding container 0b5a435231d5b5fd9e591b209566e1157f5dea20984ae118b02ab00ee0f080ec: Status 404 returned error can't find the container with id 0b5a435231d5b5fd9e591b209566e1157f5dea20984ae118b02ab00ee0f080ec Jun 09 11:02:40.846969 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.846945 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgf6g"] Jun 09 11:02:40.954852 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.954816 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxt8f"] Jun 09 11:02:40.957612 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.957586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:40.966687 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.966661 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxt8f"] Jun 09 11:02:40.975442 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:40.975412 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" event={"ID":"1035e925-2694-4421-95bc-df46f8392a07","Type":"ContainerStarted","Data":"0b5a435231d5b5fd9e591b209566e1157f5dea20984ae118b02ab00ee0f080ec"} Jun 09 11:02:41.090291 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:41.090257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tdnr\" (UniqueName: \"kubernetes.io/projected/16def278-b4e0-4b1e-9119-09cbd4f18dad-kube-api-access-7tdnr\") pod \"kuadrant-operator-catalog-wxt8f\" (UID: \"16def278-b4e0-4b1e-9119-09cbd4f18dad\") " pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:41.191307 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:41.191202 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tdnr\" (UniqueName: \"kubernetes.io/projected/16def278-b4e0-4b1e-9119-09cbd4f18dad-kube-api-access-7tdnr\") pod \"kuadrant-operator-catalog-wxt8f\" (UID: \"16def278-b4e0-4b1e-9119-09cbd4f18dad\") " pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:41.207277 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:41.207251 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tdnr\" (UniqueName: \"kubernetes.io/projected/16def278-b4e0-4b1e-9119-09cbd4f18dad-kube-api-access-7tdnr\") pod \"kuadrant-operator-catalog-wxt8f\" (UID: \"16def278-b4e0-4b1e-9119-09cbd4f18dad\") " pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:41.268803 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:41.268766 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:41.409382 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:41.409350 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16def278_b4e0_4b1e_9119_09cbd4f18dad.slice/crio-8dc78d6039b224c2d02cfc1b0d81efe26fdbd6e2ec37124591eb14d636f03121 WatchSource:0}: Error finding container 8dc78d6039b224c2d02cfc1b0d81efe26fdbd6e2ec37124591eb14d636f03121: Status 404 returned error can't find the container with id 8dc78d6039b224c2d02cfc1b0d81efe26fdbd6e2ec37124591eb14d636f03121 Jun 09 11:02:41.414750 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:41.414723 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wxt8f"] Jun 09 11:02:41.984011 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:41.983968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" event={"ID":"16def278-b4e0-4b1e-9119-09cbd4f18dad","Type":"ContainerStarted","Data":"8dc78d6039b224c2d02cfc1b0d81efe26fdbd6e2ec37124591eb14d636f03121"} Jun 09 11:02:43.994964 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:43.994914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" event={"ID":"1035e925-2694-4421-95bc-df46f8392a07","Type":"ContainerStarted","Data":"e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5"} Jun 09 11:02:43.995452 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:43.994966 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" podUID="1035e925-2694-4421-95bc-df46f8392a07" containerName="registry-server" containerID="cri-o://e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5" gracePeriod=2 Jun 09 11:02:43.996679 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:43.996633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" event={"ID":"16def278-b4e0-4b1e-9119-09cbd4f18dad","Type":"ContainerStarted","Data":"2f900e89dcd051aa52cf4257aedca704a163533b478d52d86e697fd27b9a154d"} Jun 09 11:02:44.019925 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:44.019875 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" podStartSLOduration=1.8510594139999998 podStartE2EDuration="4.019858394s" totalImagesPullingTime="2.16879898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:02:44.01785776 +0000 UTC m=+542.551412840" watchObservedRunningTime="2026-06-09 11:02:44.019858394 +0000 UTC m=+542.553413494" Jun 09 11:02:44.041776 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:44.041719 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" podStartSLOduration=2.433052053 podStartE2EDuration="4.041703901s" totalImagesPullingTime="1.608651848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:02:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:02:44.040451704 +0000 UTC m=+542.574006783" watchObservedRunningTime="2026-06-09 11:02:44.041703901 +0000 UTC m=+542.575258980" Jun 09 11:02:44.254148 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:44.254072 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:44.320173 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:44.320130 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7thx\" (UniqueName: \"kubernetes.io/projected/1035e925-2694-4421-95bc-df46f8392a07-kube-api-access-v7thx\") pod \"1035e925-2694-4421-95bc-df46f8392a07\" (UID: \"1035e925-2694-4421-95bc-df46f8392a07\") " Jun 09 11:02:44.322664 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:44.322635 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1035e925-2694-4421-95bc-df46f8392a07-kube-api-access-v7thx" (OuterVolumeSpecName: "kube-api-access-v7thx") pod "1035e925-2694-4421-95bc-df46f8392a07" (UID: "1035e925-2694-4421-95bc-df46f8392a07"). InnerVolumeSpecName "kube-api-access-v7thx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:02:44.421080 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:44.421036 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7thx\" (UniqueName: \"kubernetes.io/projected/1035e925-2694-4421-95bc-df46f8392a07-kube-api-access-v7thx\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:02:45.003041 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.003004 2562 generic.go:356] "Generic (PLEG): container finished" podID="1035e925-2694-4421-95bc-df46f8392a07" containerID="e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5" exitCode=0 Jun 09 11:02:45.003475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.003049 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" Jun 09 11:02:45.003475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.003096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" event={"ID":"1035e925-2694-4421-95bc-df46f8392a07","Type":"ContainerDied","Data":"e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5"} Jun 09 11:02:45.003475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.003138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgf6g" event={"ID":"1035e925-2694-4421-95bc-df46f8392a07","Type":"ContainerDied","Data":"0b5a435231d5b5fd9e591b209566e1157f5dea20984ae118b02ab00ee0f080ec"} Jun 09 11:02:45.003475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.003162 2562 scope.go:117] "RemoveContainer" containerID="e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5" Jun 09 11:02:45.013112 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.013093 2562 scope.go:117] "RemoveContainer" containerID="e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5" Jun 09 11:02:45.013401 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:02:45.013383 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5\": container with ID starting with e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5 not found: ID does not exist" containerID="e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5" Jun 09 11:02:45.013455 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.013411 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5"} err="failed to get container status \"e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5\": rpc error: code = NotFound desc = could not find container \"e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5\": container with ID starting with e02604ff32b62fc6f8a7bd87014cbc5492c21bf3009264089bd32eee358a41e5 not found: ID does not exist" Jun 09 11:02:45.028894 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.028863 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgf6g"] Jun 09 11:02:45.033288 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.033262 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgf6g"] Jun 09 11:02:45.875687 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:45.875654 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1035e925-2694-4421-95bc-df46f8392a07" path="/var/lib/kubelet/pods/1035e925-2694-4421-95bc-df46f8392a07/volumes" Jun 09 11:02:51.269648 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:51.269568 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:51.270096 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:51.269678 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:51.293507 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:51.293476 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:52.061343 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:52.061301 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wxt8f" Jun 09 11:02:55.577776 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.577737 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s"] Jun 09 11:02:55.578174 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.578064 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1035e925-2694-4421-95bc-df46f8392a07" containerName="registry-server" Jun 09 11:02:55.578174 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.578075 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1035e925-2694-4421-95bc-df46f8392a07" containerName="registry-server" Jun 09 11:02:55.578174 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.578130 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1035e925-2694-4421-95bc-df46f8392a07" containerName="registry-server" Jun 09 11:02:55.581259 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.581236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.586741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.586700 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhwwk\"" Jun 09 11:02:55.593059 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.593030 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s"] Jun 09 11:02:55.715931 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.715893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.715931 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.715935 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.716189 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.716012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7spf\" (UniqueName: \"kubernetes.io/projected/eee924c7-4283-409d-990e-7e47f72fd8ad-kube-api-access-b7spf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.817059 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.817005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.817263 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.817138 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7spf\" (UniqueName: \"kubernetes.io/projected/eee924c7-4283-409d-990e-7e47f72fd8ad-kube-api-access-b7spf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.817263 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.817217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.817427 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.817404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.817560 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.817540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.834387 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.834307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7spf\" (UniqueName: \"kubernetes.io/projected/eee924c7-4283-409d-990e-7e47f72fd8ad-kube-api-access-b7spf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:55.891814 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:55.891771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:02:56.039965 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:56.039932 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeee924c7_4283_409d_990e_7e47f72fd8ad.slice/crio-20a3643c3fabb8c560340867aab6ac12d056f80f67ad27eb7c9a67824265e206 WatchSource:0}: Error finding container 20a3643c3fabb8c560340867aab6ac12d056f80f67ad27eb7c9a67824265e206: Status 404 returned error can't find the container with id 20a3643c3fabb8c560340867aab6ac12d056f80f67ad27eb7c9a67824265e206 Jun 09 11:02:56.040315 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.040292 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s"] Jun 09 11:02:56.059117 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.059086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" event={"ID":"eee924c7-4283-409d-990e-7e47f72fd8ad","Type":"ContainerStarted","Data":"20a3643c3fabb8c560340867aab6ac12d056f80f67ad27eb7c9a67824265e206"} Jun 09 11:02:56.379459 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.379349 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c"] Jun 09 11:02:56.383235 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.383214 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.386299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.386271 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:02:56.396207 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.396177 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c"] Jun 09 11:02:56.525027 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.524985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.525228 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.525065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.525228 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.525114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgr8q\" (UniqueName: \"kubernetes.io/projected/71fe5a03-9d30-4992-ab60-9944da92276e-kube-api-access-pgr8q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.626267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.626220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.626267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.626275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgr8q\" (UniqueName: \"kubernetes.io/projected/71fe5a03-9d30-4992-ab60-9944da92276e-kube-api-access-pgr8q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.626725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.626305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.626725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.626632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.626725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.626658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.637846 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.637779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgr8q\" (UniqueName: \"kubernetes.io/projected/71fe5a03-9d30-4992-ab60-9944da92276e-kube-api-access-pgr8q\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.693493 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.693454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:02:56.781910 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.781869 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq"] Jun 09 11:02:56.795582 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.795545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:56.797539 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.797504 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq"] Jun 09 11:02:56.838444 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.838413 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c"] Jun 09 11:02:56.840351 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:56.840322 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fe5a03_9d30_4992_ab60_9944da92276e.slice/crio-66dc81a53d631ba97be1764471db0fbdbe0b9ed95cd5e0558839f227c33eb9e9 WatchSource:0}: Error finding container 66dc81a53d631ba97be1764471db0fbdbe0b9ed95cd5e0558839f227c33eb9e9: Status 404 returned error can't find the container with id 66dc81a53d631ba97be1764471db0fbdbe0b9ed95cd5e0558839f227c33eb9e9 Jun 09 11:02:56.929456 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.929418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8kvx\" (UniqueName: \"kubernetes.io/projected/fc48ab3d-fe86-413b-8e0a-340cbebb882f-kube-api-access-z8kvx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:56.929456 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.929459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:56.929825 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:56.929500 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.030789 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.030751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.030985 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.030870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8kvx\" (UniqueName: \"kubernetes.io/projected/fc48ab3d-fe86-413b-8e0a-340cbebb882f-kube-api-access-z8kvx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.030985 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.030905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.031249 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.031216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.031325 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.031229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.040336 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.040305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8kvx\" (UniqueName: \"kubernetes.io/projected/fc48ab3d-fe86-413b-8e0a-340cbebb882f-kube-api-access-z8kvx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.066578 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.066541 2562 generic.go:356] "Generic (PLEG): container finished" podID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerID="32cc205de7a3ad7002b9958739db7184371c0c4b1ac2b873b0af883d72fe369e" exitCode=0 Jun 09 11:02:57.066797 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.066638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" event={"ID":"eee924c7-4283-409d-990e-7e47f72fd8ad","Type":"ContainerDied","Data":"32cc205de7a3ad7002b9958739db7184371c0c4b1ac2b873b0af883d72fe369e"} Jun 09 11:02:57.068794 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.068766 2562 generic.go:356] "Generic (PLEG): container finished" podID="71fe5a03-9d30-4992-ab60-9944da92276e" containerID="4609846fe60fa34bc11cd1df2c4e781bd0d5b29eda748fc9521a8227e27f30a9" exitCode=0 Jun 09 11:02:57.068896 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.068845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" event={"ID":"71fe5a03-9d30-4992-ab60-9944da92276e","Type":"ContainerDied","Data":"4609846fe60fa34bc11cd1df2c4e781bd0d5b29eda748fc9521a8227e27f30a9"} Jun 09 11:02:57.068965 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.068904 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" event={"ID":"71fe5a03-9d30-4992-ab60-9944da92276e","Type":"ContainerStarted","Data":"66dc81a53d631ba97be1764471db0fbdbe0b9ed95cd5e0558839f227c33eb9e9"} Jun 09 11:02:57.107305 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.107255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:02:57.174891 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.174850 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj"] Jun 09 11:02:57.179834 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.179808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.186912 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.186884 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj"] Jun 09 11:02:57.256916 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.256764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq"] Jun 09 11:02:57.259502 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:57.259468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc48ab3d_fe86_413b_8e0a_340cbebb882f.slice/crio-3577fc489fc2e0a23fbcea0f71d2bc1864028c99efc7f63a9c8bd3caf0df8dce WatchSource:0}: Error finding container 3577fc489fc2e0a23fbcea0f71d2bc1864028c99efc7f63a9c8bd3caf0df8dce: Status 404 returned error can't find the container with id 3577fc489fc2e0a23fbcea0f71d2bc1864028c99efc7f63a9c8bd3caf0df8dce Jun 09 11:02:57.333569 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.333528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.333569 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.333570 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.333798 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.333632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gc2\" (UniqueName: \"kubernetes.io/projected/efe73d01-ddfb-424b-b7dc-80bb79d6d332-kube-api-access-l4gc2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.434976 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.434866 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.434976 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.434912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.434976 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.434967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gc2\" (UniqueName: \"kubernetes.io/projected/efe73d01-ddfb-424b-b7dc-80bb79d6d332-kube-api-access-l4gc2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.435379 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.435339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.435460 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.435345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.446661 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.446634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gc2\" (UniqueName: \"kubernetes.io/projected/efe73d01-ddfb-424b-b7dc-80bb79d6d332-kube-api-access-l4gc2\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.491694 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.491645 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:02:57.636750 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:02:57.636708 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe73d01_ddfb_424b_b7dc_80bb79d6d332.slice/crio-20a7c805720756fd7a3b772b4fb56e1d69db6d6ceb7b744af10c478c81a3186c WatchSource:0}: Error finding container 20a7c805720756fd7a3b772b4fb56e1d69db6d6ceb7b744af10c478c81a3186c: Status 404 returned error can't find the container with id 20a7c805720756fd7a3b772b4fb56e1d69db6d6ceb7b744af10c478c81a3186c Jun 09 11:02:57.638347 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:57.638320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj"] Jun 09 11:02:58.075939 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.075900 2562 generic.go:356] "Generic (PLEG): container finished" podID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerID="21a277125c8d3799eb71d8b24c7173549015cb191ffa05e05dbd82b351a74da0" exitCode=0 Jun 09 11:02:58.076133 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.075981 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" event={"ID":"eee924c7-4283-409d-990e-7e47f72fd8ad","Type":"ContainerDied","Data":"21a277125c8d3799eb71d8b24c7173549015cb191ffa05e05dbd82b351a74da0"} Jun 09 11:02:58.077686 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.077657 2562 generic.go:356] "Generic (PLEG): container finished" podID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerID="cfa82423fc696aff68932338b48f2faab9829175b7a551049bdbc166ce50e5d1" exitCode=0 Jun 09 11:02:58.077771 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.077738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" event={"ID":"fc48ab3d-fe86-413b-8e0a-340cbebb882f","Type":"ContainerDied","Data":"cfa82423fc696aff68932338b48f2faab9829175b7a551049bdbc166ce50e5d1"} Jun 09 11:02:58.077829 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.077798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" event={"ID":"fc48ab3d-fe86-413b-8e0a-340cbebb882f","Type":"ContainerStarted","Data":"3577fc489fc2e0a23fbcea0f71d2bc1864028c99efc7f63a9c8bd3caf0df8dce"} Jun 09 11:02:58.080235 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.080195 2562 generic.go:356] "Generic (PLEG): container finished" podID="71fe5a03-9d30-4992-ab60-9944da92276e" containerID="fd9da76b4634f6d1ae0328b193b00752306a895c537a3036aa779080f119678a" exitCode=0 Jun 09 11:02:58.080318 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.080281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" event={"ID":"71fe5a03-9d30-4992-ab60-9944da92276e","Type":"ContainerDied","Data":"fd9da76b4634f6d1ae0328b193b00752306a895c537a3036aa779080f119678a"} Jun 09 11:02:58.083193 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.082669 2562 generic.go:356] "Generic (PLEG): container finished" podID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerID="e577e7d581629318ef379bd33a8d0ba6abf321f4b1a57d72f3b638535a1950e7" exitCode=0 Jun 09 11:02:58.083193 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.082736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" event={"ID":"efe73d01-ddfb-424b-b7dc-80bb79d6d332","Type":"ContainerDied","Data":"e577e7d581629318ef379bd33a8d0ba6abf321f4b1a57d72f3b638535a1950e7"} Jun 09 11:02:58.083193 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:58.082781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" event={"ID":"efe73d01-ddfb-424b-b7dc-80bb79d6d332","Type":"ContainerStarted","Data":"20a7c805720756fd7a3b772b4fb56e1d69db6d6ceb7b744af10c478c81a3186c"} Jun 09 11:02:59.097945 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.097911 2562 generic.go:356] "Generic (PLEG): container finished" podID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerID="4236876d47acd8cece8c1c9a5f223c2a1ad7aff39c214592ec5a45550d2a9f40" exitCode=0 Jun 09 11:02:59.098394 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.097994 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" event={"ID":"eee924c7-4283-409d-990e-7e47f72fd8ad","Type":"ContainerDied","Data":"4236876d47acd8cece8c1c9a5f223c2a1ad7aff39c214592ec5a45550d2a9f40"} Jun 09 11:02:59.100183 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.100154 2562 generic.go:356] "Generic (PLEG): container finished" podID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerID="16a08dbf7a4fa0b8e0b48ec05cacf91295c7d0882a62882a3c6e236567e3941c" exitCode=0 Jun 09 11:02:59.100314 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.100243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" event={"ID":"fc48ab3d-fe86-413b-8e0a-340cbebb882f","Type":"ContainerDied","Data":"16a08dbf7a4fa0b8e0b48ec05cacf91295c7d0882a62882a3c6e236567e3941c"} Jun 09 11:02:59.102841 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.102814 2562 generic.go:356] "Generic (PLEG): container finished" podID="71fe5a03-9d30-4992-ab60-9944da92276e" containerID="efdf0887a244f5f274a7ffcccd14a9f92f9fecc3fe7a6b91af64643b6a9ffb6e" exitCode=0 Jun 09 11:02:59.102953 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.102914 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" event={"ID":"71fe5a03-9d30-4992-ab60-9944da92276e","Type":"ContainerDied","Data":"efdf0887a244f5f274a7ffcccd14a9f92f9fecc3fe7a6b91af64643b6a9ffb6e"} Jun 09 11:02:59.105018 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:02:59.104990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" event={"ID":"efe73d01-ddfb-424b-b7dc-80bb79d6d332","Type":"ContainerStarted","Data":"0616c544ce3dcb876d852e6ccba78761f68ffcff5b56ba5385a3d3c34bce0400"} Jun 09 11:03:00.112624 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.112513 2562 generic.go:356] "Generic (PLEG): container finished" podID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerID="2ddbc7ff940581793da506b720aeceef53d6490bdae20586dd7644b96ff1e9bb" exitCode=0 Jun 09 11:03:00.112624 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.112594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" event={"ID":"fc48ab3d-fe86-413b-8e0a-340cbebb882f","Type":"ContainerDied","Data":"2ddbc7ff940581793da506b720aeceef53d6490bdae20586dd7644b96ff1e9bb"} Jun 09 11:03:00.114435 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.114410 2562 generic.go:356] "Generic (PLEG): container finished" podID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerID="0616c544ce3dcb876d852e6ccba78761f68ffcff5b56ba5385a3d3c34bce0400" exitCode=0 Jun 09 11:03:00.114553 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.114489 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" event={"ID":"efe73d01-ddfb-424b-b7dc-80bb79d6d332","Type":"ContainerDied","Data":"0616c544ce3dcb876d852e6ccba78761f68ffcff5b56ba5385a3d3c34bce0400"} Jun 09 11:03:00.272363 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.272337 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:03:00.362030 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.362000 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:03:00.362295 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.362275 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-util\") pod \"71fe5a03-9d30-4992-ab60-9944da92276e\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " Jun 09 11:03:00.362372 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.362360 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgr8q\" (UniqueName: \"kubernetes.io/projected/71fe5a03-9d30-4992-ab60-9944da92276e-kube-api-access-pgr8q\") pod \"71fe5a03-9d30-4992-ab60-9944da92276e\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " Jun 09 11:03:00.362411 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.362395 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-bundle\") pod \"71fe5a03-9d30-4992-ab60-9944da92276e\" (UID: \"71fe5a03-9d30-4992-ab60-9944da92276e\") " Jun 09 11:03:00.363155 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.363099 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-bundle" (OuterVolumeSpecName: "bundle") pod "71fe5a03-9d30-4992-ab60-9944da92276e" (UID: "71fe5a03-9d30-4992-ab60-9944da92276e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:00.364580 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.364560 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71fe5a03-9d30-4992-ab60-9944da92276e-kube-api-access-pgr8q" (OuterVolumeSpecName: "kube-api-access-pgr8q") pod "71fe5a03-9d30-4992-ab60-9944da92276e" (UID: "71fe5a03-9d30-4992-ab60-9944da92276e"). InnerVolumeSpecName "kube-api-access-pgr8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:03:00.367875 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.367855 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-util" (OuterVolumeSpecName: "util") pod "71fe5a03-9d30-4992-ab60-9944da92276e" (UID: "71fe5a03-9d30-4992-ab60-9944da92276e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:00.463075 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463034 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-bundle\") pod \"eee924c7-4283-409d-990e-7e47f72fd8ad\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " Jun 09 11:03:00.463231 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463131 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7spf\" (UniqueName: \"kubernetes.io/projected/eee924c7-4283-409d-990e-7e47f72fd8ad-kube-api-access-b7spf\") pod \"eee924c7-4283-409d-990e-7e47f72fd8ad\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " Jun 09 11:03:00.463231 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463166 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-util\") pod \"eee924c7-4283-409d-990e-7e47f72fd8ad\" (UID: \"eee924c7-4283-409d-990e-7e47f72fd8ad\") " Jun 09 11:03:00.463345 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463303 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:00.463345 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463317 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/71fe5a03-9d30-4992-ab60-9944da92276e-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:00.463345 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463331 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgr8q\" (UniqueName: \"kubernetes.io/projected/71fe5a03-9d30-4992-ab60-9944da92276e-kube-api-access-pgr8q\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:00.463644 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.463587 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-bundle" (OuterVolumeSpecName: "bundle") pod "eee924c7-4283-409d-990e-7e47f72fd8ad" (UID: "eee924c7-4283-409d-990e-7e47f72fd8ad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:00.465450 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.465422 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee924c7-4283-409d-990e-7e47f72fd8ad-kube-api-access-b7spf" (OuterVolumeSpecName: "kube-api-access-b7spf") pod "eee924c7-4283-409d-990e-7e47f72fd8ad" (UID: "eee924c7-4283-409d-990e-7e47f72fd8ad"). InnerVolumeSpecName "kube-api-access-b7spf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:03:00.468995 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.468973 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-util" (OuterVolumeSpecName: "util") pod "eee924c7-4283-409d-990e-7e47f72fd8ad" (UID: "eee924c7-4283-409d-990e-7e47f72fd8ad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:00.564595 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.564535 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7spf\" (UniqueName: \"kubernetes.io/projected/eee924c7-4283-409d-990e-7e47f72fd8ad-kube-api-access-b7spf\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:00.564595 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.564586 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:00.564595 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:00.564596 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eee924c7-4283-409d-990e-7e47f72fd8ad-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:01.121847 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.121744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" event={"ID":"71fe5a03-9d30-4992-ab60-9944da92276e","Type":"ContainerDied","Data":"66dc81a53d631ba97be1764471db0fbdbe0b9ed95cd5e0558839f227c33eb9e9"} Jun 09 11:03:01.121847 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.121802 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="66dc81a53d631ba97be1764471db0fbdbe0b9ed95cd5e0558839f227c33eb9e9" Jun 09 11:03:01.121847 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.121756 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c" Jun 09 11:03:01.124014 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.123988 2562 generic.go:356] "Generic (PLEG): container finished" podID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerID="4691aaed3a90a29ca9d72f2fc78a2615bf53ebbed7f9f22fa7412233fae3f854" exitCode=0 Jun 09 11:03:01.124153 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.124132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" event={"ID":"efe73d01-ddfb-424b-b7dc-80bb79d6d332","Type":"ContainerDied","Data":"4691aaed3a90a29ca9d72f2fc78a2615bf53ebbed7f9f22fa7412233fae3f854"} Jun 09 11:03:01.126196 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.126175 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" Jun 09 11:03:01.126300 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.126203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s" event={"ID":"eee924c7-4283-409d-990e-7e47f72fd8ad","Type":"ContainerDied","Data":"20a3643c3fabb8c560340867aab6ac12d056f80f67ad27eb7c9a67824265e206"} Jun 09 11:03:01.126300 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.126238 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20a3643c3fabb8c560340867aab6ac12d056f80f67ad27eb7c9a67824265e206" Jun 09 11:03:01.267653 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.267593 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:03:01.371574 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.371528 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8kvx\" (UniqueName: \"kubernetes.io/projected/fc48ab3d-fe86-413b-8e0a-340cbebb882f-kube-api-access-z8kvx\") pod \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " Jun 09 11:03:01.371774 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.371590 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-bundle\") pod \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " Jun 09 11:03:01.371774 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.371666 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-util\") pod \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\" (UID: \"fc48ab3d-fe86-413b-8e0a-340cbebb882f\") " Jun 09 11:03:01.372111 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.372049 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-bundle" (OuterVolumeSpecName: "bundle") pod "fc48ab3d-fe86-413b-8e0a-340cbebb882f" (UID: "fc48ab3d-fe86-413b-8e0a-340cbebb882f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:01.373934 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.373905 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc48ab3d-fe86-413b-8e0a-340cbebb882f-kube-api-access-z8kvx" (OuterVolumeSpecName: "kube-api-access-z8kvx") pod "fc48ab3d-fe86-413b-8e0a-340cbebb882f" (UID: "fc48ab3d-fe86-413b-8e0a-340cbebb882f"). InnerVolumeSpecName "kube-api-access-z8kvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:03:01.377046 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.377021 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-util" (OuterVolumeSpecName: "util") pod "fc48ab3d-fe86-413b-8e0a-340cbebb882f" (UID: "fc48ab3d-fe86-413b-8e0a-340cbebb882f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:01.472373 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.472331 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8kvx\" (UniqueName: \"kubernetes.io/projected/fc48ab3d-fe86-413b-8e0a-340cbebb882f-kube-api-access-z8kvx\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:01.472373 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.472366 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:01.472373 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:01.472375 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fc48ab3d-fe86-413b-8e0a-340cbebb882f-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:02.133122 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.133086 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" Jun 09 11:03:02.133122 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.133113 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq" event={"ID":"fc48ab3d-fe86-413b-8e0a-340cbebb882f","Type":"ContainerDied","Data":"3577fc489fc2e0a23fbcea0f71d2bc1864028c99efc7f63a9c8bd3caf0df8dce"} Jun 09 11:03:02.133706 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.133160 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3577fc489fc2e0a23fbcea0f71d2bc1864028c99efc7f63a9c8bd3caf0df8dce" Jun 09 11:03:02.270453 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.270426 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:03:02.381232 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.381196 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4gc2\" (UniqueName: \"kubernetes.io/projected/efe73d01-ddfb-424b-b7dc-80bb79d6d332-kube-api-access-l4gc2\") pod \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " Jun 09 11:03:02.381432 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.381312 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-util\") pod \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " Jun 09 11:03:02.381432 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.381343 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-bundle\") pod \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\" (UID: \"efe73d01-ddfb-424b-b7dc-80bb79d6d332\") " Jun 09 11:03:02.381942 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.381904 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-bundle" (OuterVolumeSpecName: "bundle") pod "efe73d01-ddfb-424b-b7dc-80bb79d6d332" (UID: "efe73d01-ddfb-424b-b7dc-80bb79d6d332"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:02.383627 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.383583 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe73d01-ddfb-424b-b7dc-80bb79d6d332-kube-api-access-l4gc2" (OuterVolumeSpecName: "kube-api-access-l4gc2") pod "efe73d01-ddfb-424b-b7dc-80bb79d6d332" (UID: "efe73d01-ddfb-424b-b7dc-80bb79d6d332"). InnerVolumeSpecName "kube-api-access-l4gc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:03:02.387163 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.387138 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-util" (OuterVolumeSpecName: "util") pod "efe73d01-ddfb-424b-b7dc-80bb79d6d332" (UID: "efe73d01-ddfb-424b-b7dc-80bb79d6d332"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:02.482221 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.482184 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:02.482221 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.482221 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/efe73d01-ddfb-424b-b7dc-80bb79d6d332-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:02.482401 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:02.482231 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4gc2\" (UniqueName: \"kubernetes.io/projected/efe73d01-ddfb-424b-b7dc-80bb79d6d332-kube-api-access-l4gc2\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:03.139410 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:03.139377 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" Jun 09 11:03:03.139868 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:03.139409 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj" event={"ID":"efe73d01-ddfb-424b-b7dc-80bb79d6d332","Type":"ContainerDied","Data":"20a7c805720756fd7a3b772b4fb56e1d69db6d6ceb7b744af10c478c81a3186c"} Jun 09 11:03:03.139868 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:03.139458 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20a7c805720756fd7a3b772b4fb56e1d69db6d6ceb7b744af10c478c81a3186c" Jun 09 11:03:09.142926 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:09.142888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:12.207673 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:12.207639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:14.005210 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005170 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7"] Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005482 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005492 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005501 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005507 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005516 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005522 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005530 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005534 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005543 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005548 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005554 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005559 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005565 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005570 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005576 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005581 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005586 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005591 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005614 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005619 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="pull" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005628 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005633 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="extract" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005639 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="util" Jun 09 11:03:14.005655 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005644 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="util" Jun 09 11:03:14.006467 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005693 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="71fe5a03-9d30-4992-ab60-9944da92276e" containerName="extract" Jun 09 11:03:14.006467 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005703 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eee924c7-4283-409d-990e-7e47f72fd8ad" containerName="extract" Jun 09 11:03:14.006467 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005708 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe73d01-ddfb-424b-b7dc-80bb79d6d332" containerName="extract" Jun 09 11:03:14.006467 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.005714 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc48ab3d-fe86-413b-8e0a-340cbebb882f" containerName="extract" Jun 09 11:03:14.009700 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.009667 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.013503 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.013472 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7"] Jun 09 11:03:14.014742 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.014719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fst65\"" Jun 09 11:03:14.091662 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.091614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q5hs\" (UniqueName: \"kubernetes.io/projected/4fd3d593-ac6f-443e-b225-d7611a2bb083-kube-api-access-9q5hs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.091858 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.091690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fd3d593-ac6f-443e-b225-d7611a2bb083-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.192927 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.192886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fd3d593-ac6f-443e-b225-d7611a2bb083-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.193149 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.192984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q5hs\" (UniqueName: \"kubernetes.io/projected/4fd3d593-ac6f-443e-b225-d7611a2bb083-kube-api-access-9q5hs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.193339 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.193313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fd3d593-ac6f-443e-b225-d7611a2bb083-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.205236 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.205207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q5hs\" (UniqueName: \"kubernetes.io/projected/4fd3d593-ac6f-443e-b225-d7611a2bb083-kube-api-access-9q5hs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.323858 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.323762 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:14.498003 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:03:14.497972 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd3d593_ac6f_443e_b225_d7611a2bb083.slice/crio-2ec2b0c2c9c2477b79539d9779bdd94da4a22dd772f156c7ca888ad5d2950b08 WatchSource:0}: Error finding container 2ec2b0c2c9c2477b79539d9779bdd94da4a22dd772f156c7ca888ad5d2950b08: Status 404 returned error can't find the container with id 2ec2b0c2c9c2477b79539d9779bdd94da4a22dd772f156c7ca888ad5d2950b08 Jun 09 11:03:14.501790 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.501763 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7"] Jun 09 11:03:14.522348 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:14.522315 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:15.204215 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:15.204174 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" event={"ID":"4fd3d593-ac6f-443e-b225-d7611a2bb083","Type":"ContainerStarted","Data":"2ec2b0c2c9c2477b79539d9779bdd94da4a22dd772f156c7ca888ad5d2950b08"} Jun 09 11:03:16.131348 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:16.131310 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:16.526161 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:16.526126 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:17.290414 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:17.290376 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:18.889086 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:18.889050 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r"] Jun 09 11:03:18.897128 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:18.897105 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:18.900223 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:18.900195 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bz4lh\"" Jun 09 11:03:18.906545 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:18.906521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r"] Jun 09 11:03:18.937466 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:18.937418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t47b\" (UniqueName: \"kubernetes.io/projected/86d5a009-c2bc-4992-b826-7989bf9e4cd8-kube-api-access-7t47b\") pod \"authorino-operator-75cc8d5cb7-4zt4r\" (UID: \"86d5a009-c2bc-4992-b826-7989bf9e4cd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:19.038399 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.038361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t47b\" (UniqueName: \"kubernetes.io/projected/86d5a009-c2bc-4992-b826-7989bf9e4cd8-kube-api-access-7t47b\") pod \"authorino-operator-75cc8d5cb7-4zt4r\" (UID: \"86d5a009-c2bc-4992-b826-7989bf9e4cd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:19.047617 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.047566 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t47b\" (UniqueName: \"kubernetes.io/projected/86d5a009-c2bc-4992-b826-7989bf9e4cd8-kube-api-access-7t47b\") pod \"authorino-operator-75cc8d5cb7-4zt4r\" (UID: \"86d5a009-c2bc-4992-b826-7989bf9e4cd8\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:19.209586 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.209477 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:19.361714 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.361676 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r"] Jun 09 11:03:19.363325 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:03:19.363275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86d5a009_c2bc_4992_b826_7989bf9e4cd8.slice/crio-2b1a9a6ac3947b6b63f06f2c7c59170d329ee12389bb5453a974da624b7ded87 WatchSource:0}: Error finding container 2b1a9a6ac3947b6b63f06f2c7c59170d329ee12389bb5453a974da624b7ded87: Status 404 returned error can't find the container with id 2b1a9a6ac3947b6b63f06f2c7c59170d329ee12389bb5453a974da624b7ded87 Jun 09 11:03:19.364209 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.364140 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98dc7f64d-fp9d8"] Jun 09 11:03:19.369661 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.369638 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.383107 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.383082 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98dc7f64d-fp9d8"] Jun 09 11:03:19.442109 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-oauth-serving-cert\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.442267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-console-config\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.442267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36448034-9e9a-4a10-9c83-c0d98894d62f-console-serving-cert\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.442267 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-trusted-ca-bundle\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.442386 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36448034-9e9a-4a10-9c83-c0d98894d62f-console-oauth-config\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.442386 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-service-ca\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.442386 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.442371 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jqwg\" (UniqueName: \"kubernetes.io/projected/36448034-9e9a-4a10-9c83-c0d98894d62f-kube-api-access-8jqwg\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.449661 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.449635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:19.543212 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jqwg\" (UniqueName: \"kubernetes.io/projected/36448034-9e9a-4a10-9c83-c0d98894d62f-kube-api-access-8jqwg\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.543420 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-oauth-serving-cert\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.543420 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-console-config\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.543420 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36448034-9e9a-4a10-9c83-c0d98894d62f-console-serving-cert\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.543420 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-trusted-ca-bundle\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.543420 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36448034-9e9a-4a10-9c83-c0d98894d62f-console-oauth-config\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.543420 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.543416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-service-ca\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.544192 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.544148 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-service-ca\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.544329 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.544295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-console-config\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.544329 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.544306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-trusted-ca-bundle\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.544329 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.544271 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/36448034-9e9a-4a10-9c83-c0d98894d62f-oauth-serving-cert\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.545929 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.545903 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/36448034-9e9a-4a10-9c83-c0d98894d62f-console-oauth-config\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.546163 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.546143 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/36448034-9e9a-4a10-9c83-c0d98894d62f-console-serving-cert\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.565555 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.565521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jqwg\" (UniqueName: \"kubernetes.io/projected/36448034-9e9a-4a10-9c83-c0d98894d62f-kube-api-access-8jqwg\") pod \"console-98dc7f64d-fp9d8\" (UID: \"36448034-9e9a-4a10-9c83-c0d98894d62f\") " pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.587934 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.587898 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:19.682663 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.682628 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:19.687105 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.687067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:19.807398 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.807198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:19.850889 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:19.850860 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98dc7f64d-fp9d8"] Jun 09 11:03:19.852438 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:03:19.852411 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36448034_9e9a_4a10_9c83_c0d98894d62f.slice/crio-e1a1327705df21fea0fafc2300a853104f4f10bb46f6e2f8dfd803771bb4eafc WatchSource:0}: Error finding container e1a1327705df21fea0fafc2300a853104f4f10bb46f6e2f8dfd803771bb4eafc: Status 404 returned error can't find the container with id e1a1327705df21fea0fafc2300a853104f4f10bb46f6e2f8dfd803771bb4eafc Jun 09 11:03:20.167795 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:20.167665 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:20.234676 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:20.234565 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" event={"ID":"86d5a009-c2bc-4992-b826-7989bf9e4cd8","Type":"ContainerStarted","Data":"2b1a9a6ac3947b6b63f06f2c7c59170d329ee12389bb5453a974da624b7ded87"} Jun 09 11:03:20.236675 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:20.236640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98dc7f64d-fp9d8" event={"ID":"36448034-9e9a-4a10-9c83-c0d98894d62f","Type":"ContainerStarted","Data":"63c4e13a1335b0287a848e76d5bc671cbdf3df81b1f713f8142cec2653cc6580"} Jun 09 11:03:20.236844 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:20.236695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98dc7f64d-fp9d8" event={"ID":"36448034-9e9a-4a10-9c83-c0d98894d62f","Type":"ContainerStarted","Data":"e1a1327705df21fea0fafc2300a853104f4f10bb46f6e2f8dfd803771bb4eafc"} Jun 09 11:03:20.268052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:20.267994 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98dc7f64d-fp9d8" podStartSLOduration=1.267976522 podStartE2EDuration="1.267976522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:20.266374445 +0000 UTC m=+578.799929550" watchObservedRunningTime="2026-06-09 11:03:20.267976522 +0000 UTC m=+578.801531602" Jun 09 11:03:20.273772 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:20.273699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:21.387018 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:21.386978 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:23.257688 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:23.257648 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" event={"ID":"4fd3d593-ac6f-443e-b225-d7611a2bb083","Type":"ContainerStarted","Data":"5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88"} Jun 09 11:03:23.258174 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:23.257867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:23.259375 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:23.259344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" event={"ID":"86d5a009-c2bc-4992-b826-7989bf9e4cd8","Type":"ContainerStarted","Data":"be456c3454e70cdeab7a8fba0a09b3fd9bcded4f0d99ff2a6efd66e573206343"} Jun 09 11:03:23.259517 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:23.259422 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:23.300765 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:23.300696 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" podStartSLOduration=1.9332367590000001 podStartE2EDuration="10.300674995s" totalImagesPullingTime="8.367438236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:23.298353017 +0000 UTC m=+581.831908096" watchObservedRunningTime="2026-06-09 11:03:23.300674995 +0000 UTC m=+581.834230076" Jun 09 11:03:23.321928 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:23.321875 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" podStartSLOduration=1.830453965 podStartE2EDuration="5.321856003s" totalImagesPullingTime="3.491402038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:23.321690129 +0000 UTC m=+581.855245210" watchObservedRunningTime="2026-06-09 11:03:23.321856003 +0000 UTC m=+581.855411082" Jun 09 11:03:24.164138 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:24.164085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:24.263729 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:24.263682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:24.376374 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:24.376324 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:24.440764 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:24.440652 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:25.819145 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:25.819100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:25.996840 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:25.996804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:29.683343 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:29.683300 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:29.683816 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:29.683396 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:29.688402 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:29.688378 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:30.302202 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:30.302173 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98dc7f64d-fp9d8" Jun 09 11:03:30.358582 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:30.358550 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b9df46f6-rhqk7"] Jun 09 11:03:30.460751 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:30.460712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:30.558367 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:30.558281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:30.658222 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:30.658191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:30.760282 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:30.760248 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:32.340894 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:32.340861 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:32.445866 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:32.445828 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:34.267885 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:34.267848 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:34.268325 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:34.267926 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-4zt4r" Jun 09 11:03:36.025146 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.025105 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7"] Jun 09 11:03:36.025585 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.025311 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" containerName="manager" containerID="cri-o://5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88" gracePeriod=2 Jun 09 11:03:36.029939 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.029910 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7"] Jun 09 11:03:36.047372 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.047344 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p"] Jun 09 11:03:36.047734 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.047717 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" containerName="manager" Jun 09 11:03:36.047777 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.047736 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" containerName="manager" Jun 09 11:03:36.047817 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.047804 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" containerName="manager" Jun 09 11:03:36.050936 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.050911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.055141 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:36.055104 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:36.067283 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.067249 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p"] Jun 09 11:03:36.206155 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.206123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzn5p\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.206315 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.206211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l7d7\" (UniqueName: \"kubernetes.io/projected/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-kube-api-access-9l7d7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzn5p\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.273082 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.273050 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:36.278005 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:36.277949 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:36.307362 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.307318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzn5p\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.307540 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.307380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l7d7\" (UniqueName: \"kubernetes.io/projected/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-kube-api-access-9l7d7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzn5p\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.307780 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.307757 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzn5p\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.319053 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.319026 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l7d7\" (UniqueName: \"kubernetes.io/projected/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-kube-api-access-9l7d7\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fzn5p\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.331448 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.331414 2562 generic.go:356] "Generic (PLEG): container finished" podID="4fd3d593-ac6f-443e-b225-d7611a2bb083" containerID="5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88" exitCode=0 Jun 09 11:03:36.331658 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.331462 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:36.331658 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.331514 2562 scope.go:117] "RemoveContainer" containerID="5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88" Jun 09 11:03:36.336441 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:36.336412 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:36.340389 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.340372 2562 scope.go:117] "RemoveContainer" containerID="5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88" Jun 09 11:03:36.340720 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:36.340700 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88\": container with ID starting with 5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88 not found: ID does not exist" containerID="5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88" Jun 09 11:03:36.340782 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.340730 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88"} err="failed to get container status \"5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88\": rpc error: code = NotFound desc = could not find container \"5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88\": container with ID starting with 5919c07c963241c443f00535eb8177f0e0100c1e38cc33dffb446b3e603ccb88 not found: ID does not exist" Jun 09 11:03:36.408611 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.408577 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q5hs\" (UniqueName: \"kubernetes.io/projected/4fd3d593-ac6f-443e-b225-d7611a2bb083-kube-api-access-9q5hs\") pod \"4fd3d593-ac6f-443e-b225-d7611a2bb083\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " Jun 09 11:03:36.408788 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.408691 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fd3d593-ac6f-443e-b225-d7611a2bb083-extensions-socket-volume\") pod \"4fd3d593-ac6f-443e-b225-d7611a2bb083\" (UID: \"4fd3d593-ac6f-443e-b225-d7611a2bb083\") " Jun 09 11:03:36.409179 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.409152 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fd3d593-ac6f-443e-b225-d7611a2bb083-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4fd3d593-ac6f-443e-b225-d7611a2bb083" (UID: "4fd3d593-ac6f-443e-b225-d7611a2bb083"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:03:36.410853 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.410829 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd3d593-ac6f-443e-b225-d7611a2bb083-kube-api-access-9q5hs" (OuterVolumeSpecName: "kube-api-access-9q5hs") pod "4fd3d593-ac6f-443e-b225-d7611a2bb083" (UID: "4fd3d593-ac6f-443e-b225-d7611a2bb083"). InnerVolumeSpecName "kube-api-access-9q5hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:03:36.412963 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.412941 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:36.510367 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.510334 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q5hs\" (UniqueName: \"kubernetes.io/projected/4fd3d593-ac6f-443e-b225-d7611a2bb083-kube-api-access-9q5hs\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:36.510367 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.510367 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4fd3d593-ac6f-443e-b225-d7611a2bb083-extensions-socket-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:36.570940 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:03:36.570910 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8e40ee_e46e_48e9_b03f_5511b432d7a0.slice/crio-39aef3f9ce59939489eb2e6470758e11e0cd1dc2f16fde9f4ef5458a0a197106 WatchSource:0}: Error finding container 39aef3f9ce59939489eb2e6470758e11e0cd1dc2f16fde9f4ef5458a0a197106: Status 404 returned error can't find the container with id 39aef3f9ce59939489eb2e6470758e11e0cd1dc2f16fde9f4ef5458a0a197106 Jun 09 11:03:36.581727 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:36.581700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p"] Jun 09 11:03:36.648407 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:36.648371 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:37.183584 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.183555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:37.295238 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.295194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:37.338154 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.338117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" event={"ID":"cd8e40ee-e46e-48e9-b03f-5511b432d7a0","Type":"ContainerStarted","Data":"6b87fd22e200c391a14d3e4d7bf574e94a6a2aef939364f96678dc6a62e89f5d"} Jun 09 11:03:37.338367 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.338181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" event={"ID":"cd8e40ee-e46e-48e9-b03f-5511b432d7a0","Type":"ContainerStarted","Data":"39aef3f9ce59939489eb2e6470758e11e0cd1dc2f16fde9f4ef5458a0a197106"} Jun 09 11:03:37.338367 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.338313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:37.341792 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:37.341758 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k7qx7\" is forbidden: User \"system:node:ip-10-0-132-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-253.ec2.internal' and this object" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k7qx7" Jun 09 11:03:37.382301 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.382244 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" podStartSLOduration=1.382226874 podStartE2EDuration="1.382226874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:03:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:03:37.379918774 +0000 UTC m=+595.913473857" watchObservedRunningTime="2026-06-09 11:03:37.382226874 +0000 UTC m=+595.915781951" Jun 09 11:03:37.876439 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:37.876407 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd3d593-ac6f-443e-b225-d7611a2bb083" path="/var/lib/kubelet/pods/4fd3d593-ac6f-443e-b225-d7611a2bb083/volumes" Jun 09 11:03:39.595501 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:39.595465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:39.713852 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:39.713822 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:45.533280 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:45.533238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:45.633433 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:45.633391 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:48.346871 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:48.346837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:03:53.137340 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:53.137306 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:53.244881 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:53.244845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:55.387051 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.387015 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85b9df46f6-rhqk7" podUID="25b56b53-6b5e-426b-b4c6-a9621c6a85f9" containerName="console" containerID="cri-o://e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a" gracePeriod=15 Jun 09 11:03:55.627816 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.627792 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 11:03:55.678020 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.677935 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-oauth-serving-cert\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678020 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.677982 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-serving-cert\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678020 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678018 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-config\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678293 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678052 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-service-ca\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678293 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678081 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-oauth-config\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678293 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678108 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-trusted-ca-bundle\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678293 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678139 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xx2j5\" (UniqueName: \"kubernetes.io/projected/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-kube-api-access-xx2j5\") pod \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\" (UID: \"25b56b53-6b5e-426b-b4c6-a9621c6a85f9\") " Jun 09 11:03:55.678505 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678330 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:03:55.678625 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678578 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-config" (OuterVolumeSpecName: "console-config") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:03:55.678625 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678579 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:03:55.679004 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.678802 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:03:55.680409 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.680379 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:03:55.680978 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.680951 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:03:55.681060 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.680953 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-kube-api-access-xx2j5" (OuterVolumeSpecName: "kube-api-access-xx2j5") pod "25b56b53-6b5e-426b-b4c6-a9621c6a85f9" (UID: "25b56b53-6b5e-426b-b4c6-a9621c6a85f9"). InnerVolumeSpecName "kube-api-access-xx2j5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:03:55.779035 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.778986 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xx2j5\" (UniqueName: \"kubernetes.io/projected/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-kube-api-access-xx2j5\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:55.779035 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.779030 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-oauth-serving-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:55.779035 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.779040 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-serving-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:55.779035 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.779051 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:55.779035 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.779060 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-service-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:55.779359 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.779068 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-console-oauth-config\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:55.779359 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:55.779075 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/25b56b53-6b5e-426b-b4c6-a9621c6a85f9-trusted-ca-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:03:56.441807 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.441769 2562 generic.go:356] "Generic (PLEG): container finished" podID="25b56b53-6b5e-426b-b4c6-a9621c6a85f9" containerID="e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a" exitCode=0 Jun 09 11:03:56.442220 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.441815 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85b9df46f6-rhqk7" Jun 09 11:03:56.442220 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.441855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b9df46f6-rhqk7" event={"ID":"25b56b53-6b5e-426b-b4c6-a9621c6a85f9","Type":"ContainerDied","Data":"e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a"} Jun 09 11:03:56.442220 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.441913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85b9df46f6-rhqk7" event={"ID":"25b56b53-6b5e-426b-b4c6-a9621c6a85f9","Type":"ContainerDied","Data":"51b2faf52d43e44c364bbb5799a70f6209ebd363079d620f28a3118219c71802"} Jun 09 11:03:56.442220 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.441934 2562 scope.go:117] "RemoveContainer" containerID="e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a" Jun 09 11:03:56.451241 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.451218 2562 scope.go:117] "RemoveContainer" containerID="e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a" Jun 09 11:03:56.451551 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:03:56.451532 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a\": container with ID starting with e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a not found: ID does not exist" containerID="e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a" Jun 09 11:03:56.451677 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.451561 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a"} err="failed to get container status \"e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a\": rpc error: code = NotFound desc = could not find container \"e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a\": container with ID starting with e02e384742f9d6d531ade8ab5725bbec4048cc73c1d290ab9193ec594e63f46a not found: ID does not exist" Jun 09 11:03:56.468421 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.463295 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85b9df46f6-rhqk7"] Jun 09 11:03:56.472486 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:56.472460 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85b9df46f6-rhqk7"] Jun 09 11:03:57.569740 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:57.569702 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:57.667890 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:57.667848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:03:57.875815 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:03:57.875734 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b56b53-6b5e-426b-b4c6-a9621c6a85f9" path="/var/lib/kubelet/pods/25b56b53-6b5e-426b-b4c6-a9621c6a85f9/volumes" Jun 09 11:04:00.000389 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:00.000351 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:00.099036 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:00.099008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:10.271069 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.271033 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p"] Jun 09 11:04:10.271457 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.271264 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" podUID="cd8e40ee-e46e-48e9-b03f-5511b432d7a0" containerName="manager" containerID="cri-o://6b87fd22e200c391a14d3e4d7bf574e94a6a2aef939364f96678dc6a62e89f5d" gracePeriod=10 Jun 09 11:04:10.516176 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.516149 2562 generic.go:356] "Generic (PLEG): container finished" podID="cd8e40ee-e46e-48e9-b03f-5511b432d7a0" containerID="6b87fd22e200c391a14d3e4d7bf574e94a6a2aef939364f96678dc6a62e89f5d" exitCode=0 Jun 09 11:04:10.516253 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.516220 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" event={"ID":"cd8e40ee-e46e-48e9-b03f-5511b432d7a0","Type":"ContainerDied","Data":"6b87fd22e200c391a14d3e4d7bf574e94a6a2aef939364f96678dc6a62e89f5d"} Jun 09 11:04:10.516319 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.516307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" event={"ID":"cd8e40ee-e46e-48e9-b03f-5511b432d7a0","Type":"ContainerDied","Data":"39aef3f9ce59939489eb2e6470758e11e0cd1dc2f16fde9f4ef5458a0a197106"} Jun 09 11:04:10.516374 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.516327 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39aef3f9ce59939489eb2e6470758e11e0cd1dc2f16fde9f4ef5458a0a197106" Jun 09 11:04:10.529880 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.529815 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:04:10.598035 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.597997 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-extensions-socket-volume\") pod \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " Jun 09 11:04:10.598212 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.598049 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l7d7\" (UniqueName: \"kubernetes.io/projected/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-kube-api-access-9l7d7\") pod \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\" (UID: \"cd8e40ee-e46e-48e9-b03f-5511b432d7a0\") " Jun 09 11:04:10.598475 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.598448 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cd8e40ee-e46e-48e9-b03f-5511b432d7a0" (UID: "cd8e40ee-e46e-48e9-b03f-5511b432d7a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:04:10.600378 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.600353 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-kube-api-access-9l7d7" (OuterVolumeSpecName: "kube-api-access-9l7d7") pod "cd8e40ee-e46e-48e9-b03f-5511b432d7a0" (UID: "cd8e40ee-e46e-48e9-b03f-5511b432d7a0"). InnerVolumeSpecName "kube-api-access-9l7d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:04:10.699153 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.699113 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-extensions-socket-volume\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:04:10.699153 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:10.699149 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l7d7\" (UniqueName: \"kubernetes.io/projected/cd8e40ee-e46e-48e9-b03f-5511b432d7a0-kube-api-access-9l7d7\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:04:11.521449 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:11.521416 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p" Jun 09 11:04:11.543366 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:11.543326 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p"] Jun 09 11:04:11.550902 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:11.550868 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fzn5p"] Jun 09 11:04:11.876424 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:11.876326 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8e40ee-e46e-48e9-b03f-5511b432d7a0" path="/var/lib/kubelet/pods/cd8e40ee-e46e-48e9-b03f-5511b432d7a0/volumes" Jun 09 11:04:25.171120 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:25.171084 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:26.541970 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.541934 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc"] Jun 09 11:04:26.542566 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.542427 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8e40ee-e46e-48e9-b03f-5511b432d7a0" containerName="manager" Jun 09 11:04:26.542566 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.542448 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8e40ee-e46e-48e9-b03f-5511b432d7a0" containerName="manager" Jun 09 11:04:26.542566 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.542471 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b56b53-6b5e-426b-b4c6-a9621c6a85f9" containerName="console" Jun 09 11:04:26.542566 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.542480 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b56b53-6b5e-426b-b4c6-a9621c6a85f9" containerName="console" Jun 09 11:04:26.542820 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.542576 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8e40ee-e46e-48e9-b03f-5511b432d7a0" containerName="manager" Jun 09 11:04:26.542820 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.542591 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b56b53-6b5e-426b-b4c6-a9621c6a85f9" containerName="console" Jun 09 11:04:26.544640 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.544597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.547432 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.547411 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-kszqq\"" Jun 09 11:04:26.557747 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.557723 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc"] Jun 09 11:04:26.577890 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.577850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:26.644389 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644616 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644413 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644616 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644616 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644616 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644554 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644616 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmgd\" (UniqueName: \"kubernetes.io/projected/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-kube-api-access-7qmgd\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644879 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644879 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.644879 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.644748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.677674 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.677640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:26.745214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745311 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745366 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmgd\" (UniqueName: \"kubernetes.io/projected/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-kube-api-access-7qmgd\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.745859 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.745788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.746100 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.746075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.746234 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.746093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.746234 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.746148 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.746414 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.746395 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.747846 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.747825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.748319 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.748297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.760312 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.760277 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.760429 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.760324 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmgd\" (UniqueName: \"kubernetes.io/projected/9358cdb4-09f2-4563-a7d1-3a7a1c6f5329-kube-api-access-7qmgd\") pod \"maas-default-gateway-openshift-default-687ff6996-z8cvc\" (UID: \"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:26.857780 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:26.857679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:27.004672 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:04:27.004624 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9358cdb4_09f2_4563_a7d1_3a7a1c6f5329.slice/crio-939789f849b2ef938c267c7c8b6996ae39c299008ca0448b9f74f5f06567c3e2 WatchSource:0}: Error finding container 939789f849b2ef938c267c7c8b6996ae39c299008ca0448b9f74f5f06567c3e2: Status 404 returned error can't find the container with id 939789f849b2ef938c267c7c8b6996ae39c299008ca0448b9f74f5f06567c3e2 Jun 09 11:04:27.008011 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.007723 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc"] Jun 09 11:04:27.009968 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.009933 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:04:27.010077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.009997 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:04:27.010077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.010029 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:04:27.605898 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.605863 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" event={"ID":"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329","Type":"ContainerStarted","Data":"50b7333b867e9487751fbf17bc1707558101be9f62ae45a9e0e991f27ceec6fe"} Jun 09 11:04:27.606469 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.605915 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" event={"ID":"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329","Type":"ContainerStarted","Data":"939789f849b2ef938c267c7c8b6996ae39c299008ca0448b9f74f5f06567c3e2"} Jun 09 11:04:27.631223 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.631170 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" podStartSLOduration=1.6311510729999998 podStartE2EDuration="1.631151073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:04:27.628530043 +0000 UTC m=+646.162085118" watchObservedRunningTime="2026-06-09 11:04:27.631151073 +0000 UTC m=+646.164706243" Jun 09 11:04:27.858250 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:27.858155 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:28.863802 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:28.863760 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:29.616965 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:29.616927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:29.617955 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:29.617934 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:04:30.269933 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.269875 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:30.732910 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.732869 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:30.734299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.734278 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:30.736385 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.736370 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:30.739450 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.739425 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 11:04:30.741163 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.741147 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vhwwk\"" Jun 09 11:04:30.746727 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.746703 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:30.829589 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.829550 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:30.841643 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.841596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:30.884129 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.884091 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct2rp\" (UniqueName: \"kubernetes.io/projected/4e022c67-ced7-48fe-86ca-87fe6cb6053e-kube-api-access-ct2rp\") pod \"limitador-limitador-64c94fd64f-wlkmt\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:30.884305 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.884197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e022c67-ced7-48fe-86ca-87fe6cb6053e-config-file\") pod \"limitador-limitador-64c94fd64f-wlkmt\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:30.946907 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.946872 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:30.984821 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.984744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct2rp\" (UniqueName: \"kubernetes.io/projected/4e022c67-ced7-48fe-86ca-87fe6cb6053e-kube-api-access-ct2rp\") pod \"limitador-limitador-64c94fd64f-wlkmt\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:30.984928 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.984834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e022c67-ced7-48fe-86ca-87fe6cb6053e-config-file\") pod \"limitador-limitador-64c94fd64f-wlkmt\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:30.985437 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.985417 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e022c67-ced7-48fe-86ca-87fe6cb6053e-config-file\") pod \"limitador-limitador-64c94fd64f-wlkmt\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:30.994968 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:30.994937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct2rp\" (UniqueName: \"kubernetes.io/projected/4e022c67-ced7-48fe-86ca-87fe6cb6053e-kube-api-access-ct2rp\") pod \"limitador-limitador-64c94fd64f-wlkmt\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:31.048155 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.048117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:31.196188 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.196166 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:31.197939 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:04:31.197899 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e022c67_ced7_48fe_86ca_87fe6cb6053e.slice/crio-ce26ef8dea70cafc371a155228e6137cc76d3e9cce094da9f541a3edeace0b05 WatchSource:0}: Error finding container ce26ef8dea70cafc371a155228e6137cc76d3e9cce094da9f541a3edeace0b05: Status 404 returned error can't find the container with id ce26ef8dea70cafc371a155228e6137cc76d3e9cce094da9f541a3edeace0b05 Jun 09 11:04:31.563963 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.563924 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-z8sh6"] Jun 09 11:04:31.566885 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.566866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:31.569804 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.569757 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dqz64\"" Jun 09 11:04:31.574938 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.574911 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8sh6"] Jun 09 11:04:31.590513 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.590480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:31.628355 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.628321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" event={"ID":"4e022c67-ced7-48fe-86ca-87fe6cb6053e","Type":"ContainerStarted","Data":"ce26ef8dea70cafc371a155228e6137cc76d3e9cce094da9f541a3edeace0b05"} Jun 09 11:04:31.682340 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.682303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:31.691520 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.691482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q52sv\" (UniqueName: \"kubernetes.io/projected/2da2e9ad-8f51-492c-a55f-2455b1faa16c-kube-api-access-q52sv\") pod \"authorino-58cd955675-z8sh6\" (UID: \"2da2e9ad-8f51-492c-a55f-2455b1faa16c\") " pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:31.791975 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.791936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q52sv\" (UniqueName: \"kubernetes.io/projected/2da2e9ad-8f51-492c-a55f-2455b1faa16c-kube-api-access-q52sv\") pod \"authorino-58cd955675-z8sh6\" (UID: \"2da2e9ad-8f51-492c-a55f-2455b1faa16c\") " pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:31.803102 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.803067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q52sv\" (UniqueName: \"kubernetes.io/projected/2da2e9ad-8f51-492c-a55f-2455b1faa16c-kube-api-access-q52sv\") pod \"authorino-58cd955675-z8sh6\" (UID: \"2da2e9ad-8f51-492c-a55f-2455b1faa16c\") " pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:31.877470 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:31.877382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:32.011323 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:04:32.011289 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2da2e9ad_8f51_492c_a55f_2455b1faa16c.slice/crio-8ae53b5dd56a93c99ff7c2bf278147f42104c6cf518322792752b5d62198749f WatchSource:0}: Error finding container 8ae53b5dd56a93c99ff7c2bf278147f42104c6cf518322792752b5d62198749f: Status 404 returned error can't find the container with id 8ae53b5dd56a93c99ff7c2bf278147f42104c6cf518322792752b5d62198749f Jun 09 11:04:32.015714 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:32.015675 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8sh6"] Jun 09 11:04:32.639446 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:32.639401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8sh6" event={"ID":"2da2e9ad-8f51-492c-a55f-2455b1faa16c","Type":"ContainerStarted","Data":"8ae53b5dd56a93c99ff7c2bf278147f42104c6cf518322792752b5d62198749f"} Jun 09 11:04:36.432846 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:36.432753 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8sh6"] Jun 09 11:04:36.674853 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:36.674806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8sh6" event={"ID":"2da2e9ad-8f51-492c-a55f-2455b1faa16c","Type":"ContainerStarted","Data":"f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2"} Jun 09 11:04:36.676310 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:36.676280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" event={"ID":"4e022c67-ced7-48fe-86ca-87fe6cb6053e","Type":"ContainerStarted","Data":"37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad"} Jun 09 11:04:36.676464 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:36.676359 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:36.703671 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:36.703556 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-z8sh6" podStartSLOduration=1.642831099 podStartE2EDuration="5.703540223s" totalImagesPullingTime="4.060709124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:04:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:04:36.701944122 +0000 UTC m=+655.235499200" watchObservedRunningTime="2026-06-09 11:04:36.703540223 +0000 UTC m=+655.237095302" Jun 09 11:04:36.723651 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:36.723573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" podStartSLOduration=1.851223277 podStartE2EDuration="6.723557281s" totalImagesPullingTime="4.872334004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:04:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:04:36.722657863 +0000 UTC m=+655.256212944" watchObservedRunningTime="2026-06-09 11:04:36.723557281 +0000 UTC m=+655.257112360" Jun 09 11:04:37.682425 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:37.682380 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-z8sh6" podUID="2da2e9ad-8f51-492c-a55f-2455b1faa16c" containerName="authorino" containerID="cri-o://f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2" gracePeriod=30 Jun 09 11:04:37.945010 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:37.944928 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:38.053469 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.053430 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q52sv\" (UniqueName: \"kubernetes.io/projected/2da2e9ad-8f51-492c-a55f-2455b1faa16c-kube-api-access-q52sv\") pod \"2da2e9ad-8f51-492c-a55f-2455b1faa16c\" (UID: \"2da2e9ad-8f51-492c-a55f-2455b1faa16c\") " Jun 09 11:04:38.055735 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.055705 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2da2e9ad-8f51-492c-a55f-2455b1faa16c-kube-api-access-q52sv" (OuterVolumeSpecName: "kube-api-access-q52sv") pod "2da2e9ad-8f51-492c-a55f-2455b1faa16c" (UID: "2da2e9ad-8f51-492c-a55f-2455b1faa16c"). InnerVolumeSpecName "kube-api-access-q52sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:04:38.155028 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.154992 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q52sv\" (UniqueName: \"kubernetes.io/projected/2da2e9ad-8f51-492c-a55f-2455b1faa16c-kube-api-access-q52sv\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:04:38.688533 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.688498 2562 generic.go:356] "Generic (PLEG): container finished" podID="2da2e9ad-8f51-492c-a55f-2455b1faa16c" containerID="f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2" exitCode=0 Jun 09 11:04:38.689052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.688539 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-z8sh6" Jun 09 11:04:38.689052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.688584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8sh6" event={"ID":"2da2e9ad-8f51-492c-a55f-2455b1faa16c","Type":"ContainerDied","Data":"f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2"} Jun 09 11:04:38.689052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.688644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-z8sh6" event={"ID":"2da2e9ad-8f51-492c-a55f-2455b1faa16c","Type":"ContainerDied","Data":"8ae53b5dd56a93c99ff7c2bf278147f42104c6cf518322792752b5d62198749f"} Jun 09 11:04:38.689052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.688682 2562 scope.go:117] "RemoveContainer" containerID="f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2" Jun 09 11:04:38.704199 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.704179 2562 scope.go:117] "RemoveContainer" containerID="f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2" Jun 09 11:04:38.704527 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:04:38.704504 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2\": container with ID starting with f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2 not found: ID does not exist" containerID="f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2" Jun 09 11:04:38.704574 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.704537 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2"} err="failed to get container status \"f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2\": rpc error: code = NotFound desc = could not find container \"f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2\": container with ID starting with f64bb377bc66d4e624924b38af28661bc9090ea32f9c7a9ab63718898127d5e2 not found: ID does not exist" Jun 09 11:04:38.719225 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.719193 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8sh6"] Jun 09 11:04:38.726219 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:38.726192 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-z8sh6"] Jun 09 11:04:39.875667 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:39.875637 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2da2e9ad-8f51-492c-a55f-2455b1faa16c" path="/var/lib/kubelet/pods/2da2e9ad-8f51-492c-a55f-2455b1faa16c/volumes" Jun 09 11:04:45.876663 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:45.876621 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:45.877059 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:45.876840 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" podUID="4e022c67-ced7-48fe-86ca-87fe6cb6053e" containerName="limitador" containerID="cri-o://37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad" gracePeriod=30 Jun 09 11:04:45.877481 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:45.877462 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:46.436230 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.436155 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:46.531358 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.531319 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e022c67-ced7-48fe-86ca-87fe6cb6053e-config-file\") pod \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " Jun 09 11:04:46.531554 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.531430 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct2rp\" (UniqueName: \"kubernetes.io/projected/4e022c67-ced7-48fe-86ca-87fe6cb6053e-kube-api-access-ct2rp\") pod \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\" (UID: \"4e022c67-ced7-48fe-86ca-87fe6cb6053e\") " Jun 09 11:04:46.531768 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.531742 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e022c67-ced7-48fe-86ca-87fe6cb6053e-config-file" (OuterVolumeSpecName: "config-file") pod "4e022c67-ced7-48fe-86ca-87fe6cb6053e" (UID: "4e022c67-ced7-48fe-86ca-87fe6cb6053e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:04:46.533725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.533703 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e022c67-ced7-48fe-86ca-87fe6cb6053e-kube-api-access-ct2rp" (OuterVolumeSpecName: "kube-api-access-ct2rp") pod "4e022c67-ced7-48fe-86ca-87fe6cb6053e" (UID: "4e022c67-ced7-48fe-86ca-87fe6cb6053e"). InnerVolumeSpecName "kube-api-access-ct2rp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:04:46.632009 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.631953 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct2rp\" (UniqueName: \"kubernetes.io/projected/4e022c67-ced7-48fe-86ca-87fe6cb6053e-kube-api-access-ct2rp\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:04:46.632009 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.632001 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e022c67-ced7-48fe-86ca-87fe6cb6053e-config-file\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:04:46.734745 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.734713 2562 generic.go:356] "Generic (PLEG): container finished" podID="4e022c67-ced7-48fe-86ca-87fe6cb6053e" containerID="37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad" exitCode=0 Jun 09 11:04:46.734932 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.734758 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" Jun 09 11:04:46.734932 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.734806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" event={"ID":"4e022c67-ced7-48fe-86ca-87fe6cb6053e","Type":"ContainerDied","Data":"37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad"} Jun 09 11:04:46.734932 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.734856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-wlkmt" event={"ID":"4e022c67-ced7-48fe-86ca-87fe6cb6053e","Type":"ContainerDied","Data":"ce26ef8dea70cafc371a155228e6137cc76d3e9cce094da9f541a3edeace0b05"} Jun 09 11:04:46.734932 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.734880 2562 scope.go:117] "RemoveContainer" containerID="37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad" Jun 09 11:04:46.744409 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.744390 2562 scope.go:117] "RemoveContainer" containerID="37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad" Jun 09 11:04:46.744769 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:04:46.744732 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad\": container with ID starting with 37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad not found: ID does not exist" containerID="37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad" Jun 09 11:04:46.744819 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.744777 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad"} err="failed to get container status \"37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad\": rpc error: code = NotFound desc = could not find container \"37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad\": container with ID starting with 37ea3d2ca89560c2058cf8d1cbd8cbc5b8352e69b08696a33b786c0f059d9fad not found: ID does not exist" Jun 09 11:04:46.758411 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.758380 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:46.762527 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:46.762500 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-wlkmt"] Jun 09 11:04:47.876209 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:47.876177 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e022c67-ced7-48fe-86ca-87fe6cb6053e" path="/var/lib/kubelet/pods/4e022c67-ced7-48fe-86ca-87fe6cb6053e/volumes" Jun 09 11:04:51.895309 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895271 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-25mnl"] Jun 09 11:04:51.895725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895621 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e022c67-ced7-48fe-86ca-87fe6cb6053e" containerName="limitador" Jun 09 11:04:51.895725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895635 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e022c67-ced7-48fe-86ca-87fe6cb6053e" containerName="limitador" Jun 09 11:04:51.895725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895658 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da2e9ad-8f51-492c-a55f-2455b1faa16c" containerName="authorino" Jun 09 11:04:51.895725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895664 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da2e9ad-8f51-492c-a55f-2455b1faa16c" containerName="authorino" Jun 09 11:04:51.895863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895729 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e022c67-ced7-48fe-86ca-87fe6cb6053e" containerName="limitador" Jun 09 11:04:51.895863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.895738 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da2e9ad-8f51-492c-a55f-2455b1faa16c" containerName="authorino" Jun 09 11:04:51.900311 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.900288 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:51.904987 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.904658 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 11:04:51.906991 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.906959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-25mnl"] Jun 09 11:04:51.934996 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.934910 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:04:51.977478 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.977437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b937cd18-47fc-4365-9742-47fc036e9546-data\") pod \"postgres-69fb4594cf-25mnl\" (UID: \"b937cd18-47fc-4365-9742-47fc036e9546\") " pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:51.977701 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:51.977539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjbxz\" (UniqueName: \"kubernetes.io/projected/b937cd18-47fc-4365-9742-47fc036e9546-kube-api-access-kjbxz\") pod \"postgres-69fb4594cf-25mnl\" (UID: \"b937cd18-47fc-4365-9742-47fc036e9546\") " pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:52.078449 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.078415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjbxz\" (UniqueName: \"kubernetes.io/projected/b937cd18-47fc-4365-9742-47fc036e9546-kube-api-access-kjbxz\") pod \"postgres-69fb4594cf-25mnl\" (UID: \"b937cd18-47fc-4365-9742-47fc036e9546\") " pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:52.078449 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.078462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b937cd18-47fc-4365-9742-47fc036e9546-data\") pod \"postgres-69fb4594cf-25mnl\" (UID: \"b937cd18-47fc-4365-9742-47fc036e9546\") " pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:52.078838 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.078819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b937cd18-47fc-4365-9742-47fc036e9546-data\") pod \"postgres-69fb4594cf-25mnl\" (UID: \"b937cd18-47fc-4365-9742-47fc036e9546\") " pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:52.088294 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.088260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjbxz\" (UniqueName: \"kubernetes.io/projected/b937cd18-47fc-4365-9742-47fc036e9546-kube-api-access-kjbxz\") pod \"postgres-69fb4594cf-25mnl\" (UID: \"b937cd18-47fc-4365-9742-47fc036e9546\") " pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:52.214166 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.214072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:52.376062 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.375892 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-25mnl"] Jun 09 11:04:52.378515 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:04:52.378488 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb937cd18_47fc_4365_9742_47fc036e9546.slice/crio-4afbea5294766f311db8a4c37e82e36921ee618828b117f95be4fba150b8adc8 WatchSource:0}: Error finding container 4afbea5294766f311db8a4c37e82e36921ee618828b117f95be4fba150b8adc8: Status 404 returned error can't find the container with id 4afbea5294766f311db8a4c37e82e36921ee618828b117f95be4fba150b8adc8 Jun 09 11:04:52.770317 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:52.770281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-25mnl" event={"ID":"b937cd18-47fc-4365-9742-47fc036e9546","Type":"ContainerStarted","Data":"4afbea5294766f311db8a4c37e82e36921ee618828b117f95be4fba150b8adc8"} Jun 09 11:04:55.789480 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:55.789440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-25mnl" event={"ID":"b937cd18-47fc-4365-9742-47fc036e9546","Type":"ContainerStarted","Data":"478514381dcab1c1534c4fc7a6167ee68425ee017e8ab7ef6e06f54d4ee79124"} Jun 09 11:04:55.789889 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:55.789552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:04:55.809526 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:04:55.809452 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-25mnl" podStartSLOduration=2.3239172679999998 podStartE2EDuration="4.809429244s" totalImagesPullingTime="2.485511976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:04:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:04:55.806468023 +0000 UTC m=+674.340023103" watchObservedRunningTime="2026-06-09 11:04:55.809429244 +0000 UTC m=+674.342984325" Jun 09 11:05:01.828883 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:01.828844 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-25mnl" Jun 09 11:05:02.148909 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:02.148825 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:02.253094 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:02.253054 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:02.434193 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:02.434082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:03.430332 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.430294 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54"] Jun 09 11:05:03.436980 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.436957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.443840 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.443803 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 11:05:03.444153 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.444121 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7mxzp\"" Jun 09 11:05:03.445413 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.445371 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 11:05:03.448637 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.448596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54"] Jun 09 11:05:03.480907 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.480864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.481101 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.480989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m86h2\" (UniqueName: \"kubernetes.io/projected/2d958995-bf17-4aeb-bf64-088810fd6128-kube-api-access-m86h2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.481101 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.481031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.581769 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.581730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m86h2\" (UniqueName: \"kubernetes.io/projected/2d958995-bf17-4aeb-bf64-088810fd6128-kube-api-access-m86h2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.581769 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.581777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.582005 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.581833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.582211 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.582187 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.582251 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.582233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.591734 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.591703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m86h2\" (UniqueName: \"kubernetes.io/projected/2d958995-bf17-4aeb-bf64-088810fd6128-kube-api-access-m86h2\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.753114 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.753075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:03.894888 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:03.894863 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54"] Jun 09 11:05:03.896422 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:05:03.896386 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d958995_bf17_4aeb_bf64_088810fd6128.slice/crio-f07b6fc36e92333979c4e3078c6747b79488e72f6492b17d1e5a3130489b9993 WatchSource:0}: Error finding container f07b6fc36e92333979c4e3078c6747b79488e72f6492b17d1e5a3130489b9993: Status 404 returned error can't find the container with id f07b6fc36e92333979c4e3078c6747b79488e72f6492b17d1e5a3130489b9993 Jun 09 11:05:04.837909 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:04.837875 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d958995-bf17-4aeb-bf64-088810fd6128" containerID="08b26a4a1855d72f78a6f261be912dca191af58f24569112720733eba14e34e4" exitCode=0 Jun 09 11:05:04.838332 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:04.837958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" event={"ID":"2d958995-bf17-4aeb-bf64-088810fd6128","Type":"ContainerDied","Data":"08b26a4a1855d72f78a6f261be912dca191af58f24569112720733eba14e34e4"} Jun 09 11:05:04.838332 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:04.838021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" event={"ID":"2d958995-bf17-4aeb-bf64-088810fd6128","Type":"ContainerStarted","Data":"f07b6fc36e92333979c4e3078c6747b79488e72f6492b17d1e5a3130489b9993"} Jun 09 11:05:05.845741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:05.845649 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d958995-bf17-4aeb-bf64-088810fd6128" containerID="34a8f8a6ea5aec96255e9a9889aca931b07e236dea763e96814b46a06a081b2a" exitCode=0 Jun 09 11:05:05.846105 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:05.845734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" event={"ID":"2d958995-bf17-4aeb-bf64-088810fd6128","Type":"ContainerDied","Data":"34a8f8a6ea5aec96255e9a9889aca931b07e236dea763e96814b46a06a081b2a"} Jun 09 11:05:06.853080 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:06.853048 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d958995-bf17-4aeb-bf64-088810fd6128" containerID="85c3ceca16bc9b256bb36b7b5c34d7263ecd963d96418e1b9511c00833642d9b" exitCode=0 Jun 09 11:05:06.853471 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:06.853128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" event={"ID":"2d958995-bf17-4aeb-bf64-088810fd6128","Type":"ContainerDied","Data":"85c3ceca16bc9b256bb36b7b5c34d7263ecd963d96418e1b9511c00833642d9b"} Jun 09 11:05:08.067888 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.067851 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:08.120784 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.120688 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m86h2\" (UniqueName: \"kubernetes.io/projected/2d958995-bf17-4aeb-bf64-088810fd6128-kube-api-access-m86h2\") pod \"2d958995-bf17-4aeb-bf64-088810fd6128\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " Jun 09 11:05:08.120784 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.120741 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-util\") pod \"2d958995-bf17-4aeb-bf64-088810fd6128\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " Jun 09 11:05:08.120784 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.120777 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-bundle\") pod \"2d958995-bf17-4aeb-bf64-088810fd6128\" (UID: \"2d958995-bf17-4aeb-bf64-088810fd6128\") " Jun 09 11:05:08.121349 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.121318 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-bundle" (OuterVolumeSpecName: "bundle") pod "2d958995-bf17-4aeb-bf64-088810fd6128" (UID: "2d958995-bf17-4aeb-bf64-088810fd6128"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:05:08.123133 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.123105 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d958995-bf17-4aeb-bf64-088810fd6128-kube-api-access-m86h2" (OuterVolumeSpecName: "kube-api-access-m86h2") pod "2d958995-bf17-4aeb-bf64-088810fd6128" (UID: "2d958995-bf17-4aeb-bf64-088810fd6128"). InnerVolumeSpecName "kube-api-access-m86h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:05:08.125725 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.125691 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-util" (OuterVolumeSpecName: "util") pod "2d958995-bf17-4aeb-bf64-088810fd6128" (UID: "2d958995-bf17-4aeb-bf64-088810fd6128"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:05:08.221977 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.221932 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m86h2\" (UniqueName: \"kubernetes.io/projected/2d958995-bf17-4aeb-bf64-088810fd6128-kube-api-access-m86h2\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:05:08.221977 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.221968 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-util\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:05:08.221977 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.221980 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2d958995-bf17-4aeb-bf64-088810fd6128-bundle\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:05:08.865623 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.865577 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" Jun 09 11:05:08.865822 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.865632 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748v8m54" event={"ID":"2d958995-bf17-4aeb-bf64-088810fd6128","Type":"ContainerDied","Data":"f07b6fc36e92333979c4e3078c6747b79488e72f6492b17d1e5a3130489b9993"} Jun 09 11:05:08.865822 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:08.865719 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f07b6fc36e92333979c4e3078c6747b79488e72f6492b17d1e5a3130489b9993" Jun 09 11:05:11.118705 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.118668 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-nfdwz"] Jun 09 11:05:11.119115 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119024 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="util" Jun 09 11:05:11.119115 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119036 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="util" Jun 09 11:05:11.119115 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119045 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="extract" Jun 09 11:05:11.119115 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119051 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="extract" Jun 09 11:05:11.119115 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119062 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="pull" Jun 09 11:05:11.119115 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119068 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="pull" Jun 09 11:05:11.119308 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.119129 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d958995-bf17-4aeb-bf64-088810fd6128" containerName="extract" Jun 09 11:05:11.123877 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.123855 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" Jun 09 11:05:11.130289 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.130264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-hhhwv\"" Jun 09 11:05:11.130423 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.130264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 11:05:11.131445 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.131425 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 11:05:11.165622 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.165569 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-nfdwz"] Jun 09 11:05:11.250992 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.250953 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk7lf\" (UniqueName: \"kubernetes.io/projected/22616bb3-01c5-4b06-9c9a-96f881bda747-kube-api-access-lk7lf\") pod \"keycloak-operator-d67dbbb48-nfdwz\" (UID: \"22616bb3-01c5-4b06-9c9a-96f881bda747\") " pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" Jun 09 11:05:11.352220 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.352177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk7lf\" (UniqueName: \"kubernetes.io/projected/22616bb3-01c5-4b06-9c9a-96f881bda747-kube-api-access-lk7lf\") pod \"keycloak-operator-d67dbbb48-nfdwz\" (UID: \"22616bb3-01c5-4b06-9c9a-96f881bda747\") " pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" Jun 09 11:05:11.362551 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.362518 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk7lf\" (UniqueName: \"kubernetes.io/projected/22616bb3-01c5-4b06-9c9a-96f881bda747-kube-api-access-lk7lf\") pod \"keycloak-operator-d67dbbb48-nfdwz\" (UID: \"22616bb3-01c5-4b06-9c9a-96f881bda747\") " pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" Jun 09 11:05:11.435173 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.435073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" Jun 09 11:05:11.573694 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.573657 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-nfdwz"] Jun 09 11:05:11.574318 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:05:11.574295 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22616bb3_01c5_4b06_9c9a_96f881bda747.slice/crio-1f54fff63b678a8081408f722b8b4c1348c5a8bc07c8c32a108a59df5069e013 WatchSource:0}: Error finding container 1f54fff63b678a8081408f722b8b4c1348c5a8bc07c8c32a108a59df5069e013: Status 404 returned error can't find the container with id 1f54fff63b678a8081408f722b8b4c1348c5a8bc07c8c32a108a59df5069e013 Jun 09 11:05:11.881903 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:11.881867 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" event={"ID":"22616bb3-01c5-4b06-9c9a-96f881bda747","Type":"ContainerStarted","Data":"1f54fff63b678a8081408f722b8b4c1348c5a8bc07c8c32a108a59df5069e013"} Jun 09 11:05:17.920945 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:17.920902 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" event={"ID":"22616bb3-01c5-4b06-9c9a-96f881bda747","Type":"ContainerStarted","Data":"75d386fcd6870f75102b810aabae1a6de98d5a8ed31c52c0601b3adb70eee866"} Jun 09 11:05:17.945041 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:17.944933 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-nfdwz" podStartSLOduration=0.839504958 podStartE2EDuration="6.944913774s" totalImagesPullingTime="6.105408816s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:05:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:05:17.943119796 +0000 UTC m=+696.476674876" watchObservedRunningTime="2026-06-09 11:05:17.944913774 +0000 UTC m=+696.478468854" Jun 09 11:05:26.829071 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:26.828983 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:26.926025 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:26.925986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:56.427656 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.427588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:56.526469 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.526431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:05:56.655003 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.654967 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xnkbh"] Jun 09 11:05:56.657280 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.657263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:56.660314 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.660295 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-dqz64\"" Jun 09 11:05:56.666084 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.666058 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xnkbh"] Jun 09 11:05:56.755040 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.754999 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcpsj\" (UniqueName: \"kubernetes.io/projected/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c-kube-api-access-dcpsj\") pod \"authorino-5d4b67c446-xnkbh\" (UID: \"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c\") " pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:56.855947 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.855910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcpsj\" (UniqueName: \"kubernetes.io/projected/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c-kube-api-access-dcpsj\") pod \"authorino-5d4b67c446-xnkbh\" (UID: \"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c\") " pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:56.864951 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.864917 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcpsj\" (UniqueName: \"kubernetes.io/projected/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c-kube-api-access-dcpsj\") pod \"authorino-5d4b67c446-xnkbh\" (UID: \"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c\") " pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:56.899514 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.899475 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xnkbh"] Jun 09 11:05:56.899780 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.899767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:56.927379 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.927346 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67b95cd8d6-swwth"] Jun 09 11:05:56.929845 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.929823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:56.939653 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:56.939627 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67b95cd8d6-swwth"] Jun 09 11:05:57.045077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.045041 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xnkbh"] Jun 09 11:05:57.045496 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:05:57.045468 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca5da7e5_a4f3_48cc_a100_8ac72c4f133c.slice/crio-0952bebe4fe12b12ade60a2e787cbc8c24aef2e2fd4aabd843b34105cbb96b0e WatchSource:0}: Error finding container 0952bebe4fe12b12ade60a2e787cbc8c24aef2e2fd4aabd843b34105cbb96b0e: Status 404 returned error can't find the container with id 0952bebe4fe12b12ade60a2e787cbc8c24aef2e2fd4aabd843b34105cbb96b0e Jun 09 11:05:57.047009 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.046993 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:05:57.057190 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.057165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqkts\" (UniqueName: \"kubernetes.io/projected/de41ded5-de6f-4c06-a5c7-dd763a6659cc-kube-api-access-qqkts\") pod \"authorino-67b95cd8d6-swwth\" (UID: \"de41ded5-de6f-4c06-a5c7-dd763a6659cc\") " pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:57.104308 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.103250 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b95cd8d6-swwth"] Jun 09 11:05:57.104308 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:05:57.103838 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qqkts], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-67b95cd8d6-swwth" podUID="de41ded5-de6f-4c06-a5c7-dd763a6659cc" Jun 09 11:05:57.129745 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.129700 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f88c6748b-s9sq2"] Jun 09 11:05:57.132154 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.132135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.135396 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.135374 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 11:05:57.140002 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.139769 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f88c6748b-s9sq2"] Jun 09 11:05:57.146340 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.146318 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:57.146484 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.146322 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" event={"ID":"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c","Type":"ContainerStarted","Data":"0952bebe4fe12b12ade60a2e787cbc8c24aef2e2fd4aabd843b34105cbb96b0e"} Jun 09 11:05:57.152938 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.152911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:57.158259 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.158231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqkts\" (UniqueName: \"kubernetes.io/projected/de41ded5-de6f-4c06-a5c7-dd763a6659cc-kube-api-access-qqkts\") pod \"authorino-67b95cd8d6-swwth\" (UID: \"de41ded5-de6f-4c06-a5c7-dd763a6659cc\") " pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:57.168677 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.168635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqkts\" (UniqueName: \"kubernetes.io/projected/de41ded5-de6f-4c06-a5c7-dd763a6659cc-kube-api-access-qqkts\") pod \"authorino-67b95cd8d6-swwth\" (UID: \"de41ded5-de6f-4c06-a5c7-dd763a6659cc\") " pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:57.259659 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.259594 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqkts\" (UniqueName: \"kubernetes.io/projected/de41ded5-de6f-4c06-a5c7-dd763a6659cc-kube-api-access-qqkts\") pod \"de41ded5-de6f-4c06-a5c7-dd763a6659cc\" (UID: \"de41ded5-de6f-4c06-a5c7-dd763a6659cc\") " Jun 09 11:05:57.259829 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.259748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e8241f-0c58-4e83-a161-c23689a4ba37-tls-cert\") pod \"authorino-6f88c6748b-s9sq2\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.259872 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.259825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ml6s\" (UniqueName: \"kubernetes.io/projected/40e8241f-0c58-4e83-a161-c23689a4ba37-kube-api-access-4ml6s\") pod \"authorino-6f88c6748b-s9sq2\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.261987 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.261960 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de41ded5-de6f-4c06-a5c7-dd763a6659cc-kube-api-access-qqkts" (OuterVolumeSpecName: "kube-api-access-qqkts") pod "de41ded5-de6f-4c06-a5c7-dd763a6659cc" (UID: "de41ded5-de6f-4c06-a5c7-dd763a6659cc"). InnerVolumeSpecName "kube-api-access-qqkts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:05:57.360688 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.360544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ml6s\" (UniqueName: \"kubernetes.io/projected/40e8241f-0c58-4e83-a161-c23689a4ba37-kube-api-access-4ml6s\") pod \"authorino-6f88c6748b-s9sq2\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.360861 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.360696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e8241f-0c58-4e83-a161-c23689a4ba37-tls-cert\") pod \"authorino-6f88c6748b-s9sq2\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.360861 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.360756 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqkts\" (UniqueName: \"kubernetes.io/projected/de41ded5-de6f-4c06-a5c7-dd763a6659cc-kube-api-access-qqkts\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:05:57.363334 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.363300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e8241f-0c58-4e83-a161-c23689a4ba37-tls-cert\") pod \"authorino-6f88c6748b-s9sq2\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.372704 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.372683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ml6s\" (UniqueName: \"kubernetes.io/projected/40e8241f-0c58-4e83-a161-c23689a4ba37-kube-api-access-4ml6s\") pod \"authorino-6f88c6748b-s9sq2\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.443127 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.443100 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:05:57.591482 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:57.591457 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f88c6748b-s9sq2"] Jun 09 11:05:57.593068 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:05:57.593028 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40e8241f_0c58_4e83_a161_c23689a4ba37.slice/crio-d4cf1cbde53a1ec6e9223d33e72cd9422487db75e763db2b6f630cbfa697d02c WatchSource:0}: Error finding container d4cf1cbde53a1ec6e9223d33e72cd9422487db75e763db2b6f630cbfa697d02c: Status 404 returned error can't find the container with id d4cf1cbde53a1ec6e9223d33e72cd9422487db75e763db2b6f630cbfa697d02c Jun 09 11:05:58.153155 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.153060 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" event={"ID":"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c","Type":"ContainerStarted","Data":"8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1"} Jun 09 11:05:58.153155 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.153105 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" podUID="ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" containerName="authorino" containerID="cri-o://8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1" gracePeriod=30 Jun 09 11:05:58.154841 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.154815 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" event={"ID":"40e8241f-0c58-4e83-a161-c23689a4ba37","Type":"ContainerStarted","Data":"6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7"} Jun 09 11:05:58.154954 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.154844 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67b95cd8d6-swwth" Jun 09 11:05:58.154954 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.154852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" event={"ID":"40e8241f-0c58-4e83-a161-c23689a4ba37","Type":"ContainerStarted","Data":"d4cf1cbde53a1ec6e9223d33e72cd9422487db75e763db2b6f630cbfa697d02c"} Jun 09 11:05:58.172150 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.172104 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" podStartSLOduration=1.821930942 podStartE2EDuration="2.172084254s" totalImagesPullingTime="350.153312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:05:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:05:58.170054716 +0000 UTC m=+736.703609796" watchObservedRunningTime="2026-06-09 11:05:58.172084254 +0000 UTC m=+736.705639335" Jun 09 11:05:58.204826 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.204787 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67b95cd8d6-swwth"] Jun 09 11:05:58.207001 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.206978 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67b95cd8d6-swwth"] Jun 09 11:05:58.220622 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.220551 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" podStartSLOduration=0.879337434 podStartE2EDuration="1.22053458s" totalImagesPullingTime="341.197146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:05:58.219876583 +0000 UTC m=+736.753431664" watchObservedRunningTime="2026-06-09 11:05:58.22053458 +0000 UTC m=+736.754089660" Jun 09 11:05:58.398229 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.398203 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:58.472744 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.472715 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcpsj\" (UniqueName: \"kubernetes.io/projected/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c-kube-api-access-dcpsj\") pod \"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c\" (UID: \"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c\") " Jun 09 11:05:58.474942 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.474917 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c-kube-api-access-dcpsj" (OuterVolumeSpecName: "kube-api-access-dcpsj") pod "ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" (UID: "ca5da7e5-a4f3-48cc-a100-8ac72c4f133c"). InnerVolumeSpecName "kube-api-access-dcpsj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:05:58.573578 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:58.573532 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcpsj\" (UniqueName: \"kubernetes.io/projected/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c-kube-api-access-dcpsj\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:05:59.161648 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.161536 2562 generic.go:356] "Generic (PLEG): container finished" podID="ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" containerID="8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1" exitCode=0 Jun 09 11:05:59.161648 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.161583 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" Jun 09 11:05:59.161843 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.161643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" event={"ID":"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c","Type":"ContainerDied","Data":"8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1"} Jun 09 11:05:59.161843 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.161685 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xnkbh" event={"ID":"ca5da7e5-a4f3-48cc-a100-8ac72c4f133c","Type":"ContainerDied","Data":"0952bebe4fe12b12ade60a2e787cbc8c24aef2e2fd4aabd843b34105cbb96b0e"} Jun 09 11:05:59.161843 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.161706 2562 scope.go:117] "RemoveContainer" containerID="8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1" Jun 09 11:05:59.171166 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.171144 2562 scope.go:117] "RemoveContainer" containerID="8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1" Jun 09 11:05:59.171444 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:05:59.171423 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1\": container with ID starting with 8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1 not found: ID does not exist" containerID="8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1" Jun 09 11:05:59.171508 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.171453 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1"} err="failed to get container status \"8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1\": rpc error: code = NotFound desc = could not find container \"8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1\": container with ID starting with 8725b3dbc4fb11e25d331d3ad3c1dcf02abab31adc79bf0a3ec8d6acf9aaa9a1 not found: ID does not exist" Jun 09 11:05:59.185149 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.185118 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xnkbh"] Jun 09 11:05:59.189231 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.189206 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xnkbh"] Jun 09 11:05:59.876292 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.876256 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" path="/var/lib/kubelet/pods/ca5da7e5-a4f3-48cc-a100-8ac72c4f133c/volumes" Jun 09 11:05:59.876715 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:05:59.876632 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de41ded5-de6f-4c06-a5c7-dd763a6659cc" path="/var/lib/kubelet/pods/de41ded5-de6f-4c06-a5c7-dd763a6659cc/volumes" Jun 09 11:06:01.802578 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:01.802538 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:01.910207 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:01.910178 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:02.000701 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:02.000651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:05.095982 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:05.095945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:05.191659 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:05.191596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:36.078524 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:36.078490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:36.326260 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:36.326208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:36.517136 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:36.517091 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:36.588941 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:36.588908 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:38.858836 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:38.858803 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:06:44.429728 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.429633 2562 generic.go:356] "Generic (PLEG): container finished" podID="9358cdb4-09f2-4563-a7d1-3a7a1c6f5329" containerID="50b7333b867e9487751fbf17bc1707558101be9f62ae45a9e0e991f27ceec6fe" exitCode=0 Jun 09 11:06:44.429728 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.429681 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" event={"ID":"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329","Type":"ContainerDied","Data":"50b7333b867e9487751fbf17bc1707558101be9f62ae45a9e0e991f27ceec6fe"} Jun 09 11:06:44.430214 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.430138 2562 scope.go:117] "RemoveContainer" containerID="50b7333b867e9487751fbf17bc1707558101be9f62ae45a9e0e991f27ceec6fe" Jun 09 11:06:44.431530 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.431493 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:06:44.431654 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.431583 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:06:44.431707 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.431680 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"} Jun 09 11:06:44.617304 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:44.617262 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:06:45.437674 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:45.437638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" event={"ID":"9358cdb4-09f2-4563-a7d1-3a7a1c6f5329","Type":"ContainerStarted","Data":"9a35c102781fc86df7f065cc92c8f72830a237ff28cd8d82496e6a9ac877cdb4"} Jun 09 11:06:45.858476 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:45.858440 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:06:45.859695 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:45.859670 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-z8cvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jun 09 11:06:45.859808 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:45.859742 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" podUID="9358cdb4-09f2-4563-a7d1-3a7a1c6f5329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jun 09 11:06:46.858395 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:46.858348 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-z8cvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jun 09 11:06:46.858942 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:46.858423 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" podUID="9358cdb4-09f2-4563-a7d1-3a7a1c6f5329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jun 09 11:06:47.859040 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:47.858994 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-z8cvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jun 09 11:06:47.859429 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:47.859072 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" podUID="9358cdb4-09f2-4563-a7d1-3a7a1c6f5329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jun 09 11:06:48.858276 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:48.858232 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-z8cvc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jun 09 11:06:48.858488 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:48.858297 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" podUID="9358cdb4-09f2-4563-a7d1-3a7a1c6f5329" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jun 09 11:06:49.863015 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:49.862973 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:06:49.863480 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:49.863274 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:06:49.864038 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:06:49.864020 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-z8cvc" Jun 09 11:07:24.329477 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.329436 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76595845bd-p7zqm"] Jun 09 11:07:24.329952 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.329815 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" containerName="authorino" Jun 09 11:07:24.329952 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.329828 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" containerName="authorino" Jun 09 11:07:24.329952 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.329895 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca5da7e5-a4f3-48cc-a100-8ac72c4f133c" containerName="authorino" Jun 09 11:07:24.338268 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.338231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.341179 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.341133 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76595845bd-p7zqm"] Jun 09 11:07:24.341336 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.341322 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 11:07:24.452148 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.452103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw9bp\" (UniqueName: \"kubernetes.io/projected/4336a24e-a935-4963-a83a-88c60e306367-kube-api-access-fw9bp\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.452148 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.452150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4336a24e-a935-4963-a83a-88c60e306367-oidc-ca\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.452391 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.452186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4336a24e-a935-4963-a83a-88c60e306367-tls-cert\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.553158 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.553122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4336a24e-a935-4963-a83a-88c60e306367-tls-cert\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.553378 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.553220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw9bp\" (UniqueName: \"kubernetes.io/projected/4336a24e-a935-4963-a83a-88c60e306367-kube-api-access-fw9bp\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.553378 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.553246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4336a24e-a935-4963-a83a-88c60e306367-oidc-ca\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.554004 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.553980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4336a24e-a935-4963-a83a-88c60e306367-oidc-ca\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.555912 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.555886 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4336a24e-a935-4963-a83a-88c60e306367-tls-cert\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.562503 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.562479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw9bp\" (UniqueName: \"kubernetes.io/projected/4336a24e-a935-4963-a83a-88c60e306367-kube-api-access-fw9bp\") pod \"authorino-76595845bd-p7zqm\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.648994 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.648892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:07:24.792509 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:24.792480 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76595845bd-p7zqm"] Jun 09 11:07:24.793669 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:07:24.793645 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4336a24e_a935_4963_a83a_88c60e306367.slice/crio-29f6cad8b0ea84681258e316214e10f4ac26fa430c8fd9d1de5f33a62cceae72 WatchSource:0}: Error finding container 29f6cad8b0ea84681258e316214e10f4ac26fa430c8fd9d1de5f33a62cceae72: Status 404 returned error can't find the container with id 29f6cad8b0ea84681258e316214e10f4ac26fa430c8fd9d1de5f33a62cceae72 Jun 09 11:07:25.659433 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:25.659394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76595845bd-p7zqm" event={"ID":"4336a24e-a935-4963-a83a-88c60e306367","Type":"ContainerStarted","Data":"55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245"} Jun 09 11:07:25.659998 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:25.659973 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76595845bd-p7zqm" event={"ID":"4336a24e-a935-4963-a83a-88c60e306367","Type":"ContainerStarted","Data":"29f6cad8b0ea84681258e316214e10f4ac26fa430c8fd9d1de5f33a62cceae72"} Jun 09 11:07:25.678536 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:25.678486 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76595845bd-p7zqm" podStartSLOduration=1.296670892 podStartE2EDuration="1.678468358s" totalImagesPullingTime="381.797466ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:07:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:07:25.676057455 +0000 UTC m=+824.209612535" watchObservedRunningTime="2026-06-09 11:07:25.678468358 +0000 UTC m=+824.212023479" Jun 09 11:07:25.703924 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:25.703885 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f88c6748b-s9sq2"] Jun 09 11:07:25.704098 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:25.704071 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" podUID="40e8241f-0c58-4e83-a161-c23689a4ba37" containerName="authorino" containerID="cri-o://6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7" gracePeriod=30 Jun 09 11:07:25.968421 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:25.968391 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:07:26.065409 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.065373 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4ml6s\" (UniqueName: \"kubernetes.io/projected/40e8241f-0c58-4e83-a161-c23689a4ba37-kube-api-access-4ml6s\") pod \"40e8241f-0c58-4e83-a161-c23689a4ba37\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " Jun 09 11:07:26.065594 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.065419 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e8241f-0c58-4e83-a161-c23689a4ba37-tls-cert\") pod \"40e8241f-0c58-4e83-a161-c23689a4ba37\" (UID: \"40e8241f-0c58-4e83-a161-c23689a4ba37\") " Jun 09 11:07:26.067774 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.067743 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e8241f-0c58-4e83-a161-c23689a4ba37-kube-api-access-4ml6s" (OuterVolumeSpecName: "kube-api-access-4ml6s") pod "40e8241f-0c58-4e83-a161-c23689a4ba37" (UID: "40e8241f-0c58-4e83-a161-c23689a4ba37"). InnerVolumeSpecName "kube-api-access-4ml6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:07:26.076398 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.076370 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/40e8241f-0c58-4e83-a161-c23689a4ba37-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "40e8241f-0c58-4e83-a161-c23689a4ba37" (UID: "40e8241f-0c58-4e83-a161-c23689a4ba37"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:07:26.142979 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.142940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:26.166077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.166040 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4ml6s\" (UniqueName: \"kubernetes.io/projected/40e8241f-0c58-4e83-a161-c23689a4ba37-kube-api-access-4ml6s\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:07:26.166077 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.166071 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/40e8241f-0c58-4e83-a161-c23689a4ba37-tls-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:07:26.666398 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.666358 2562 generic.go:356] "Generic (PLEG): container finished" podID="40e8241f-0c58-4e83-a161-c23689a4ba37" containerID="6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7" exitCode=0 Jun 09 11:07:26.666825 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.666407 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" Jun 09 11:07:26.666825 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.666436 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" event={"ID":"40e8241f-0c58-4e83-a161-c23689a4ba37","Type":"ContainerDied","Data":"6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7"} Jun 09 11:07:26.666825 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.666482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f88c6748b-s9sq2" event={"ID":"40e8241f-0c58-4e83-a161-c23689a4ba37","Type":"ContainerDied","Data":"d4cf1cbde53a1ec6e9223d33e72cd9422487db75e763db2b6f630cbfa697d02c"} Jun 09 11:07:26.666825 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.666505 2562 scope.go:117] "RemoveContainer" containerID="6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7" Jun 09 11:07:26.676712 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.676684 2562 scope.go:117] "RemoveContainer" containerID="6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7" Jun 09 11:07:26.677015 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:07:26.676991 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7\": container with ID starting with 6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7 not found: ID does not exist" containerID="6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7" Jun 09 11:07:26.677080 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.677028 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7"} err="failed to get container status \"6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7\": rpc error: code = NotFound desc = could not find container \"6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7\": container with ID starting with 6921c2d01e8cfcf5a52bb46202a52aab83636a71f086923bcf795ce69be8d3b7 not found: ID does not exist" Jun 09 11:07:26.689441 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.689410 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f88c6748b-s9sq2"] Jun 09 11:07:26.695968 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:26.695936 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f88c6748b-s9sq2"] Jun 09 11:07:27.165430 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:27.165396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:27.876741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:27.876708 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40e8241f-0c58-4e83-a161-c23689a4ba37" path="/var/lib/kubelet/pods/40e8241f-0c58-4e83-a161-c23689a4ba37/volumes" Jun 09 11:07:43.395865 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:43.395826 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:45.859221 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:45.859179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:07:46.419621 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:07:46.419560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:05.842990 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:08:05.842952 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:12.181899 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:08:12.181849 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:14.089829 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:08:14.089786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:29.028040 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:08:29.027946 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:08:40.113040 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:08:40.112995 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:18.251343 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:18.251304 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:18.351859 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:18.351815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:41.933807 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:41.933773 2562 scope.go:117] "RemoveContainer" containerID="6b87fd22e200c391a14d3e4d7bf574e94a6a2aef939364f96678dc6a62e89f5d" Jun 09 11:09:44.882377 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.882334 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6967b75d4f-sv8m2"] Jun 09 11:09:44.882863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.882733 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e8241f-0c58-4e83-a161-c23689a4ba37" containerName="authorino" Jun 09 11:09:44.882863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.882752 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e8241f-0c58-4e83-a161-c23689a4ba37" containerName="authorino" Jun 09 11:09:44.882863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.882824 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="40e8241f-0c58-4e83-a161-c23689a4ba37" containerName="authorino" Jun 09 11:09:44.887381 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.887359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:44.900308 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.900274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6967b75d4f-sv8m2"] Jun 09 11:09:44.950112 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.950069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8737671d-661b-46e7-82ea-6af37d95ac65-tls-cert\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:44.950327 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.950112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rws94\" (UniqueName: \"kubernetes.io/projected/8737671d-661b-46e7-82ea-6af37d95ac65-kube-api-access-rws94\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:44.950327 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:44.950225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8737671d-661b-46e7-82ea-6af37d95ac65-oidc-ca\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.050782 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.050742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8737671d-661b-46e7-82ea-6af37d95ac65-tls-cert\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.050782 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.050783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rws94\" (UniqueName: \"kubernetes.io/projected/8737671d-661b-46e7-82ea-6af37d95ac65-kube-api-access-rws94\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.051045 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.050816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8737671d-661b-46e7-82ea-6af37d95ac65-oidc-ca\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.051466 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.051443 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/8737671d-661b-46e7-82ea-6af37d95ac65-oidc-ca\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.053414 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.053391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8737671d-661b-46e7-82ea-6af37d95ac65-tls-cert\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.058938 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.058911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rws94\" (UniqueName: \"kubernetes.io/projected/8737671d-661b-46e7-82ea-6af37d95ac65-kube-api-access-rws94\") pod \"authorino-6967b75d4f-sv8m2\" (UID: \"8737671d-661b-46e7-82ea-6af37d95ac65\") " pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.196713 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.196591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6967b75d4f-sv8m2" Jun 09 11:09:45.345734 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.345700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6967b75d4f-sv8m2"] Jun 09 11:09:45.347118 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:09:45.347091 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8737671d_661b_46e7_82ea_6af37d95ac65.slice/crio-52433339dc0b74d0b68ba314ef22161b8db112d3e4efc76f5658359a1467278d WatchSource:0}: Error finding container 52433339dc0b74d0b68ba314ef22161b8db112d3e4efc76f5658359a1467278d: Status 404 returned error can't find the container with id 52433339dc0b74d0b68ba314ef22161b8db112d3e4efc76f5658359a1467278d Jun 09 11:09:45.353410 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.353386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:45.419520 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.419482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6967b75d4f-sv8m2" event={"ID":"8737671d-661b-46e7-82ea-6af37d95ac65","Type":"ContainerStarted","Data":"52433339dc0b74d0b68ba314ef22161b8db112d3e4efc76f5658359a1467278d"} Jun 09 11:09:45.447287 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:45.447189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:46.428433 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.428389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6967b75d4f-sv8m2" event={"ID":"8737671d-661b-46e7-82ea-6af37d95ac65","Type":"ContainerStarted","Data":"7b9e05ff9bef06b29cc3ffb388dedca2ddccbb666bb753d7b3b288bb07d3bb4e"} Jun 09 11:09:46.455079 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.454956 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6967b75d4f-sv8m2" podStartSLOduration=2.09758286 podStartE2EDuration="2.454937897s" totalImagesPullingTime="357.355037ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:09:46.452578178 +0000 UTC m=+964.986133251" watchObservedRunningTime="2026-06-09 11:09:46.454937897 +0000 UTC m=+964.988493008" Jun 09 11:09:46.495703 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.495657 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76595845bd-p7zqm"] Jun 09 11:09:46.495908 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.495853 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76595845bd-p7zqm" podUID="4336a24e-a935-4963-a83a-88c60e306367" containerName="authorino" containerID="cri-o://55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245" gracePeriod=30 Jun 09 11:09:46.539487 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.539435 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:46.648590 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.648555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:09:46.757093 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.757068 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:09:46.869939 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.869908 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4336a24e-a935-4963-a83a-88c60e306367-tls-cert\") pod \"4336a24e-a935-4963-a83a-88c60e306367\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " Jun 09 11:09:46.870132 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.869999 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw9bp\" (UniqueName: \"kubernetes.io/projected/4336a24e-a935-4963-a83a-88c60e306367-kube-api-access-fw9bp\") pod \"4336a24e-a935-4963-a83a-88c60e306367\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " Jun 09 11:09:46.870132 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.870041 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4336a24e-a935-4963-a83a-88c60e306367-oidc-ca\") pod \"4336a24e-a935-4963-a83a-88c60e306367\" (UID: \"4336a24e-a935-4963-a83a-88c60e306367\") " Jun 09 11:09:46.872245 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.872207 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4336a24e-a935-4963-a83a-88c60e306367-kube-api-access-fw9bp" (OuterVolumeSpecName: "kube-api-access-fw9bp") pod "4336a24e-a935-4963-a83a-88c60e306367" (UID: "4336a24e-a935-4963-a83a-88c60e306367"). InnerVolumeSpecName "kube-api-access-fw9bp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:09:46.874945 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.874909 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4336a24e-a935-4963-a83a-88c60e306367-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "4336a24e-a935-4963-a83a-88c60e306367" (UID: "4336a24e-a935-4963-a83a-88c60e306367"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:09:46.880357 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.880328 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4336a24e-a935-4963-a83a-88c60e306367-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "4336a24e-a935-4963-a83a-88c60e306367" (UID: "4336a24e-a935-4963-a83a-88c60e306367"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:09:46.971019 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.970971 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw9bp\" (UniqueName: \"kubernetes.io/projected/4336a24e-a935-4963-a83a-88c60e306367-kube-api-access-fw9bp\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:09:46.971019 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.971010 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/4336a24e-a935-4963-a83a-88c60e306367-oidc-ca\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:09:46.971019 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:46.971020 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4336a24e-a935-4963-a83a-88c60e306367-tls-cert\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:09:47.441112 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.441003 2562 generic.go:356] "Generic (PLEG): container finished" podID="4336a24e-a935-4963-a83a-88c60e306367" containerID="55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245" exitCode=0 Jun 09 11:09:47.441112 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.441067 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76595845bd-p7zqm" Jun 09 11:09:47.441872 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.441094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76595845bd-p7zqm" event={"ID":"4336a24e-a935-4963-a83a-88c60e306367","Type":"ContainerDied","Data":"55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245"} Jun 09 11:09:47.441872 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.441152 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76595845bd-p7zqm" event={"ID":"4336a24e-a935-4963-a83a-88c60e306367","Type":"ContainerDied","Data":"29f6cad8b0ea84681258e316214e10f4ac26fa430c8fd9d1de5f33a62cceae72"} Jun 09 11:09:47.441872 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.441175 2562 scope.go:117] "RemoveContainer" containerID="55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245" Jun 09 11:09:47.456240 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.456217 2562 scope.go:117] "RemoveContainer" containerID="55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245" Jun 09 11:09:47.456580 ip-10-0-132-253 kubenswrapper[2562]: E0609 11:09:47.456553 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245\": container with ID starting with 55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245 not found: ID does not exist" containerID="55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245" Jun 09 11:09:47.456745 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.456587 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245"} err="failed to get container status \"55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245\": rpc error: code = NotFound desc = could not find container \"55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245\": container with ID starting with 55d14685efa07a36e5b11725d8bd037e1bc911f9aa46d039a350c92f36fc1245 not found: ID does not exist" Jun 09 11:09:47.470734 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.470695 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76595845bd-p7zqm"] Jun 09 11:09:47.478583 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.478547 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76595845bd-p7zqm"] Jun 09 11:09:47.876668 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:09:47.876622 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4336a24e-a935-4963-a83a-88c60e306367" path="/var/lib/kubelet/pods/4336a24e-a935-4963-a83a-88c60e306367/volumes" Jun 09 11:10:34.631807 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:10:34.631771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:11:17.699159 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:17.699109 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:11:19.195998 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.195962 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:11:19.330940 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.330908 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69b588cdd-24c88"] Jun 09 11:11:19.331266 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.331253 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4336a24e-a935-4963-a83a-88c60e306367" containerName="authorino" Jun 09 11:11:19.331310 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.331268 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4336a24e-a935-4963-a83a-88c60e306367" containerName="authorino" Jun 09 11:11:19.331346 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.331337 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4336a24e-a935-4963-a83a-88c60e306367" containerName="authorino" Jun 09 11:11:19.334522 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.334504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.341580 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.341555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 11:11:19.341580 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.341555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vmhvj\"" Jun 09 11:11:19.341836 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.341785 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 11:11:19.344415 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.344392 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b588cdd-24c88"] Jun 09 11:11:19.398044 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.398003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn4cv\" (UniqueName: \"kubernetes.io/projected/c62be25f-2c26-42d1-856d-9730b4354bbc-kube-api-access-wn4cv\") pod \"maas-controller-69b588cdd-24c88\" (UID: \"c62be25f-2c26-42d1-856d-9730b4354bbc\") " pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.398274 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.398055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c62be25f-2c26-42d1-856d-9730b4354bbc-webhook-cert\") pod \"maas-controller-69b588cdd-24c88\" (UID: \"c62be25f-2c26-42d1-856d-9730b4354bbc\") " pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.498587 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.498543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c62be25f-2c26-42d1-856d-9730b4354bbc-webhook-cert\") pod \"maas-controller-69b588cdd-24c88\" (UID: \"c62be25f-2c26-42d1-856d-9730b4354bbc\") " pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.498795 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.498692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn4cv\" (UniqueName: \"kubernetes.io/projected/c62be25f-2c26-42d1-856d-9730b4354bbc-kube-api-access-wn4cv\") pod \"maas-controller-69b588cdd-24c88\" (UID: \"c62be25f-2c26-42d1-856d-9730b4354bbc\") " pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.501229 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.501203 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c62be25f-2c26-42d1-856d-9730b4354bbc-webhook-cert\") pod \"maas-controller-69b588cdd-24c88\" (UID: \"c62be25f-2c26-42d1-856d-9730b4354bbc\") " pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.507836 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.507814 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn4cv\" (UniqueName: \"kubernetes.io/projected/c62be25f-2c26-42d1-856d-9730b4354bbc-kube-api-access-wn4cv\") pod \"maas-controller-69b588cdd-24c88\" (UID: \"c62be25f-2c26-42d1-856d-9730b4354bbc\") " pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.645829 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.645775 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:19.782102 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.782070 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69b588cdd-24c88"] Jun 09 11:11:19.783262 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:11:19.783232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62be25f_2c26_42d1_856d_9730b4354bbc.slice/crio-2a33f532aa60548f12dce1c3e731085490e790dd5c488bc7dba53709577934e9 WatchSource:0}: Error finding container 2a33f532aa60548f12dce1c3e731085490e790dd5c488bc7dba53709577934e9: Status 404 returned error can't find the container with id 2a33f532aa60548f12dce1c3e731085490e790dd5c488bc7dba53709577934e9 Jun 09 11:11:19.784697 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.784656 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:11:19.963287 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:19.963250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b588cdd-24c88" event={"ID":"c62be25f-2c26-42d1-856d-9730b4354bbc","Type":"ContainerStarted","Data":"2a33f532aa60548f12dce1c3e731085490e790dd5c488bc7dba53709577934e9"} Jun 09 11:11:22.984952 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:22.984912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69b588cdd-24c88" event={"ID":"c62be25f-2c26-42d1-856d-9730b4354bbc","Type":"ContainerStarted","Data":"68cc4c08074c068b252251979794098f84002224721f227613037e5a34d9fd84"} Jun 09 11:11:22.985419 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:22.985032 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:11:23.003177 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:23.003059 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69b588cdd-24c88" podStartSLOduration=1.611983215 podStartE2EDuration="4.003040054s" totalImagesPullingTime="2.391056839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:11:23.002799753 +0000 UTC m=+1061.536354835" watchObservedRunningTime="2026-06-09 11:11:23.003040054 +0000 UTC m=+1061.536595134" Jun 09 11:11:33.997552 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:11:33.997511 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69b588cdd-24c88" Jun 09 11:12:01.596984 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:01.596943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:01.700025 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:01.699990 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:10.089823 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:10.089779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:15.859390 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:15.859344 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:15.914757 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:15.914721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:48.033899 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:48.033867 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:49.254993 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:49.254954 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:12:50.134808 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:12:50.134766 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:07.420223 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:07.420117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:12.045816 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:12.045781 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:17.786415 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:17.786377 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:17.893020 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:17.892982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:17.987520 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:17.987477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:18.150141 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:18.150046 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:18.264518 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:18.264481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:34.700975 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:34.700934 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:34.813755 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:34.813718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:34.924954 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:34.924917 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:40.688636 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:40.688567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:40.744838 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:40.744774 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:48.837111 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:48.837074 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:48.939715 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:48.939671 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:49.044336 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:49.044300 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:49.136535 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:49.136441 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:13:55.667805 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:13:55.667738 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:05.619926 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:05.619891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:05.731193 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:05.731152 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:05.848713 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:05.848670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:11.462285 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:11.462249 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:11.522117 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:11.522079 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:17.612086 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:17.612040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:17.674489 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:17.674448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:34.126169 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:34.126080 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:34.226997 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:34.226951 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:34.357654 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:34.357620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:40.096545 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:40.096504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:40.167748 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:40.167713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:40.243152 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:40.243120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:40.341005 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:40.340971 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:40.453425 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:40.453327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:46.142776 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:46.142739 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:14:46.198681 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:14:46.198637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:15:00.147874 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.147835 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683395-2dg2w"] Jun 09 11:15:00.151485 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.151456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:00.154696 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.154670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-pmrsd\"" Jun 09 11:15:00.157883 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.157857 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683395-2dg2w"] Jun 09 11:15:00.290034 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.289989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vswm\" (UniqueName: \"kubernetes.io/projected/fae743cc-2c02-41ab-b1ee-ac6d63a9aae6-kube-api-access-5vswm\") pod \"maas-api-key-cleanup-29683395-2dg2w\" (UID: \"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6\") " pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:00.391348 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.391304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vswm\" (UniqueName: \"kubernetes.io/projected/fae743cc-2c02-41ab-b1ee-ac6d63a9aae6-kube-api-access-5vswm\") pod \"maas-api-key-cleanup-29683395-2dg2w\" (UID: \"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6\") " pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:00.402583 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.402507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vswm\" (UniqueName: \"kubernetes.io/projected/fae743cc-2c02-41ab-b1ee-ac6d63a9aae6-kube-api-access-5vswm\") pod \"maas-api-key-cleanup-29683395-2dg2w\" (UID: \"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6\") " pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:00.464943 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.464906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:00.605109 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:00.605078 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683395-2dg2w"] Jun 09 11:15:00.606325 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:15:00.606301 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfae743cc_2c02_41ab_b1ee_ac6d63a9aae6.slice/crio-7f81e303bd6cde3b513d7bf0b9087f5b22dd56a448d694f1d7473b391622a7cd WatchSource:0}: Error finding container 7f81e303bd6cde3b513d7bf0b9087f5b22dd56a448d694f1d7473b391622a7cd: Status 404 returned error can't find the container with id 7f81e303bd6cde3b513d7bf0b9087f5b22dd56a448d694f1d7473b391622a7cd Jun 09 11:15:01.198130 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:01.198093 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" event={"ID":"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6","Type":"ContainerStarted","Data":"7f81e303bd6cde3b513d7bf0b9087f5b22dd56a448d694f1d7473b391622a7cd"} Jun 09 11:15:03.212110 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:03.212071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" event={"ID":"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6","Type":"ContainerStarted","Data":"3bc8ef75a4d2571181205270c7280b6b307595d2229fb9db88bb967b2bd14392"} Jun 09 11:15:03.230162 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:03.230049 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" podStartSLOduration=1.190829662 podStartE2EDuration="3.230032186s" totalImagesPullingTime="2.039202524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:15:03.227669822 +0000 UTC m=+1281.761224905" watchObservedRunningTime="2026-06-09 11:15:03.230032186 +0000 UTC m=+1281.763587267" Jun 09 11:15:04.219089 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:04.219053 2562 generic.go:356] "Generic (PLEG): container finished" podID="fae743cc-2c02-41ab-b1ee-ac6d63a9aae6" containerID="3bc8ef75a4d2571181205270c7280b6b307595d2229fb9db88bb967b2bd14392" exitCode=0 Jun 09 11:15:04.219558 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:04.219136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" event={"ID":"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6","Type":"ContainerDied","Data":"3bc8ef75a4d2571181205270c7280b6b307595d2229fb9db88bb967b2bd14392"} Jun 09 11:15:05.365412 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:05.365385 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:05.438854 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:05.438810 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5vswm\" (UniqueName: \"kubernetes.io/projected/fae743cc-2c02-41ab-b1ee-ac6d63a9aae6-kube-api-access-5vswm\") pod \"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6\" (UID: \"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6\") " Jun 09 11:15:05.441198 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:05.441163 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fae743cc-2c02-41ab-b1ee-ac6d63a9aae6-kube-api-access-5vswm" (OuterVolumeSpecName: "kube-api-access-5vswm") pod "fae743cc-2c02-41ab-b1ee-ac6d63a9aae6" (UID: "fae743cc-2c02-41ab-b1ee-ac6d63a9aae6"). InnerVolumeSpecName "kube-api-access-5vswm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:15:05.539956 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:05.539847 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5vswm\" (UniqueName: \"kubernetes.io/projected/fae743cc-2c02-41ab-b1ee-ac6d63a9aae6-kube-api-access-5vswm\") on node \"ip-10-0-132-253.ec2.internal\" DevicePath \"\"" Jun 09 11:15:06.231389 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:06.231355 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" Jun 09 11:15:06.231575 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:06.231389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683395-2dg2w" event={"ID":"fae743cc-2c02-41ab-b1ee-ac6d63a9aae6","Type":"ContainerDied","Data":"7f81e303bd6cde3b513d7bf0b9087f5b22dd56a448d694f1d7473b391622a7cd"} Jun 09 11:15:06.231575 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:15:06.231440 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f81e303bd6cde3b513d7bf0b9087f5b22dd56a448d694f1d7473b391622a7cd" Jun 09 11:16:44.601542 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:16:44.601501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:18.106511 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:18.106423 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6967b75d4f-sv8m2_8737671d-661b-46e7-82ea-6af37d95ac65/authorino/0.log" Jun 09 11:19:22.762497 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:22.762459 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86df8c8b8b-tx8qn_e55c90a8-dd15-40fb-aa04-1a21f14b8fd0/nginx/0.log" Jun 09 11:19:23.222956 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:23.222923 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683395-2dg2w_fae743cc-2c02-41ab-b1ee-ac6d63a9aae6/cleanup/0.log" Jun 09 11:19:23.336888 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:23.336836 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b588cdd-24c88_c62be25f-2c26-42d1-856d-9730b4354bbc/manager/0.log" Jun 09 11:19:23.455297 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:23.455267 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-w4lrc_a07ea475-389c-4ee6-bd4f-68e20e64ad40/server/0.log" Jun 09 11:19:23.569493 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:23.569400 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tmr64_a57bb5c4-16df-43ae-90a6-1b208f4b4860/manager/0.log" Jun 09 11:19:23.677343 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:23.677314 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-jd4mt_9f144f0a-6e47-4703-a879-6149089f54bc/copy-manifests/0.log" Jun 09 11:19:23.685045 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:23.685012 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-jd4mt_9f144f0a-6e47-4703-a879-6149089f54bc/manager/0.log" Jun 09 11:19:24.044801 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.044771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-25mnl_b937cd18-47fc-4365-9742-47fc036e9546/postgres/0.log" Jun 09 11:19:24.812355 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.812326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq_fc48ab3d-fe86-413b-8e0a-340cbebb882f/pull/0.log" Jun 09 11:19:24.819403 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.819374 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq_fc48ab3d-fe86-413b-8e0a-340cbebb882f/extract/0.log" Jun 09 11:19:24.825710 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.825685 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq_fc48ab3d-fe86-413b-8e0a-340cbebb882f/util/0.log" Jun 09 11:19:24.934911 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.934876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s_eee924c7-4283-409d-990e-7e47f72fd8ad/pull/0.log" Jun 09 11:19:24.941500 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.941476 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s_eee924c7-4283-409d-990e-7e47f72fd8ad/extract/0.log" Jun 09 11:19:24.947746 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:24.947727 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s_eee924c7-4283-409d-990e-7e47f72fd8ad/util/0.log" Jun 09 11:19:25.058490 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.058458 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c_71fe5a03-9d30-4992-ab60-9944da92276e/util/0.log" Jun 09 11:19:25.065694 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.065620 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c_71fe5a03-9d30-4992-ab60-9944da92276e/pull/0.log" Jun 09 11:19:25.072760 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.072726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c_71fe5a03-9d30-4992-ab60-9944da92276e/extract/0.log" Jun 09 11:19:25.185167 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.185139 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj_efe73d01-ddfb-424b-b7dc-80bb79d6d332/util/0.log" Jun 09 11:19:25.191943 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.191908 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj_efe73d01-ddfb-424b-b7dc-80bb79d6d332/pull/0.log" Jun 09 11:19:25.198900 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.198872 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj_efe73d01-ddfb-424b-b7dc-80bb79d6d332/extract/0.log" Jun 09 11:19:25.315222 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.315192 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6967b75d4f-sv8m2_8737671d-661b-46e7-82ea-6af37d95ac65/authorino/0.log" Jun 09 11:19:25.431885 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.431800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4zt4r_86d5a009-c2bc-4992-b826-7989bf9e4cd8/manager/0.log" Jun 09 11:19:25.790289 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:25.790253 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wxt8f_16def278-b4e0-4b1e-9119-09cbd4f18dad/registry-server/0.log" Jun 09 11:19:26.480910 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:26.480863 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tfdd5_635127a6-8601-4d8b-b72c-793f7ffe972c/istio-proxy/0.log" Jun 09 11:19:26.928354 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:26.928266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/1.log" Jun 09 11:19:27.272093 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:27.272064 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754456dd49-6xrfv_741fb71d-fff7-4a65-b5e1-15ae31bf9c12/router/0.log" Jun 09 11:19:32.407412 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.407359 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8zbsl/must-gather-h8jks"] Jun 09 11:19:32.407908 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.407830 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fae743cc-2c02-41ab-b1ee-ac6d63a9aae6" containerName="cleanup" Jun 09 11:19:32.407908 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.407846 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fae743cc-2c02-41ab-b1ee-ac6d63a9aae6" containerName="cleanup" Jun 09 11:19:32.407989 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.407917 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fae743cc-2c02-41ab-b1ee-ac6d63a9aae6" containerName="cleanup" Jun 09 11:19:32.411244 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.411221 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.414547 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.414526 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zbsl\"/\"openshift-service-ca.crt\"" Jun 09 11:19:32.415911 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.415891 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8zbsl\"/\"default-dockercfg-whb2r\"" Jun 09 11:19:32.415983 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.415928 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8zbsl\"/\"kube-root-ca.crt\"" Jun 09 11:19:32.421000 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.420971 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zbsl/must-gather-h8jks"] Jun 09 11:19:32.477219 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.477182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rwfg\" (UniqueName: \"kubernetes.io/projected/dacf291d-daf0-4136-8d59-bf864141c20c-kube-api-access-6rwfg\") pod \"must-gather-h8jks\" (UID: \"dacf291d-daf0-4136-8d59-bf864141c20c\") " pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.477424 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.477236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dacf291d-daf0-4136-8d59-bf864141c20c-must-gather-output\") pod \"must-gather-h8jks\" (UID: \"dacf291d-daf0-4136-8d59-bf864141c20c\") " pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.578677 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.578631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rwfg\" (UniqueName: \"kubernetes.io/projected/dacf291d-daf0-4136-8d59-bf864141c20c-kube-api-access-6rwfg\") pod \"must-gather-h8jks\" (UID: \"dacf291d-daf0-4136-8d59-bf864141c20c\") " pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.578874 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.578694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dacf291d-daf0-4136-8d59-bf864141c20c-must-gather-output\") pod \"must-gather-h8jks\" (UID: \"dacf291d-daf0-4136-8d59-bf864141c20c\") " pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.579025 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.579010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dacf291d-daf0-4136-8d59-bf864141c20c-must-gather-output\") pod \"must-gather-h8jks\" (UID: \"dacf291d-daf0-4136-8d59-bf864141c20c\") " pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.589255 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.589218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rwfg\" (UniqueName: \"kubernetes.io/projected/dacf291d-daf0-4136-8d59-bf864141c20c-kube-api-access-6rwfg\") pod \"must-gather-h8jks\" (UID: \"dacf291d-daf0-4136-8d59-bf864141c20c\") " pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.721566 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.721539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zbsl/must-gather-h8jks" Jun 09 11:19:32.863103 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.863071 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zbsl/must-gather-h8jks"] Jun 09 11:19:32.864109 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:19:32.864078 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddacf291d_daf0_4136_8d59_bf864141c20c.slice/crio-13bc5587cde47833d0c3ff7c730db8d5cfefaacf7f5738ce163e2cfd4c1e1f5c WatchSource:0}: Error finding container 13bc5587cde47833d0c3ff7c730db8d5cfefaacf7f5738ce163e2cfd4c1e1f5c: Status 404 returned error can't find the container with id 13bc5587cde47833d0c3ff7c730db8d5cfefaacf7f5738ce163e2cfd4c1e1f5c Jun 09 11:19:32.865966 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:32.865946 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:19:33.061771 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:33.061666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:33.716946 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:33.716902 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/must-gather-h8jks" event={"ID":"dacf291d-daf0-4136-8d59-bf864141c20c","Type":"ContainerStarted","Data":"3f22e4d1131334fbc2f45a91c84669b7e0f39b6d0c6355474ad81f41a20612b3"} Jun 09 11:19:33.717416 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:33.716964 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/must-gather-h8jks" event={"ID":"dacf291d-daf0-4136-8d59-bf864141c20c","Type":"ContainerStarted","Data":"13bc5587cde47833d0c3ff7c730db8d5cfefaacf7f5738ce163e2cfd4c1e1f5c"} Jun 09 11:19:34.096924 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:34.096881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:19:34.726681 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:34.726639 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/must-gather-h8jks" event={"ID":"dacf291d-daf0-4136-8d59-bf864141c20c","Type":"ContainerStarted","Data":"d952e51a7ad5d12939b8de70854c2f4f696df81eacb80707e25d0c4b5e52d2a4"} Jun 09 11:19:34.747164 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:34.747089 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8zbsl/must-gather-h8jks" podStartSLOduration=2.009187638 podStartE2EDuration="2.747066173s" totalImagesPullingTime="737.878535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:19:34.743800119 +0000 UTC m=+1553.277355199" watchObservedRunningTime="2026-06-09 11:19:34.747066173 +0000 UTC m=+1553.280621253" Jun 09 11:19:35.473982 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:35.473951 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rwwrq_9e955645-c813-4671-bbbd-d0286e634ff3/global-pull-secret-syncer/0.log" Jun 09 11:19:35.529457 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:35.529417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" Jun 09 11:19:35.644022 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:35.643992 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-253.ec2.internal_7952f9e65afac5824d2c2c83b0d6b99f/haproxy/0.log" Jun 09 11:19:39.671313 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.671256 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq_fc48ab3d-fe86-413b-8e0a-340cbebb882f/extract/0.log" Jun 09 11:19:39.707271 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.707238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq_fc48ab3d-fe86-413b-8e0a-340cbebb882f/util/0.log" Jun 09 11:19:39.744964 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.744878 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75924jxq_fc48ab3d-fe86-413b-8e0a-340cbebb882f/pull/0.log" Jun 09 11:19:39.793985 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.793954 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s_eee924c7-4283-409d-990e-7e47f72fd8ad/extract/0.log" Jun 09 11:19:39.819201 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.819175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s_eee924c7-4283-409d-990e-7e47f72fd8ad/util/0.log" Jun 09 11:19:39.848515 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.848487 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0cp64s_eee924c7-4283-409d-990e-7e47f72fd8ad/pull/0.log" Jun 09 11:19:39.898125 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.898028 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c_71fe5a03-9d30-4992-ab60-9944da92276e/extract/0.log" Jun 09 11:19:39.923096 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.922964 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c_71fe5a03-9d30-4992-ab60-9944da92276e/util/0.log" Jun 09 11:19:39.952170 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.952079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738bg2c_71fe5a03-9d30-4992-ab60-9944da92276e/pull/0.log" Jun 09 11:19:39.987200 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:39.987134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj_efe73d01-ddfb-424b-b7dc-80bb79d6d332/extract/0.log" Jun 09 11:19:40.019211 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:40.019137 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj_efe73d01-ddfb-424b-b7dc-80bb79d6d332/util/0.log" Jun 09 11:19:40.048589 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:40.048551 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1h2bcj_efe73d01-ddfb-424b-b7dc-80bb79d6d332/pull/0.log" Jun 09 11:19:40.254944 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:40.254835 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6967b75d4f-sv8m2_8737671d-661b-46e7-82ea-6af37d95ac65/authorino/0.log" Jun 09 11:19:40.285093 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:40.285055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-4zt4r_86d5a009-c2bc-4992-b826-7989bf9e4cd8/manager/0.log" Jun 09 11:19:40.406075 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:40.406030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wxt8f_16def278-b4e0-4b1e-9119-09cbd4f18dad/registry-server/0.log" Jun 09 11:19:43.031236 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:43.031192 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lbmlj_2e110f5d-ffff-418b-b129-0c1b67a13ce7/node-exporter/0.log" Jun 09 11:19:43.060738 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:43.060694 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lbmlj_2e110f5d-ffff-418b-b129-0c1b67a13ce7/kube-rbac-proxy/0.log" Jun 09 11:19:43.098706 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:43.098681 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lbmlj_2e110f5d-ffff-418b-b129-0c1b67a13ce7/init-textfile/0.log" Jun 09 11:19:45.458914 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:45.458882 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-nz968_184f2c3c-5894-4520-a346-3645bb9470c6/networking-console-plugin/0.log" Jun 09 11:19:46.673933 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.673904 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-98dc7f64d-fp9d8_36448034-9e9a-4a10-9c83-c0d98894d62f/console/0.log" Jun 09 11:19:46.710709 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.710672 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-nz7rj_b4f34111-2c72-4bf9-9c31-607890a7485b/download-server/0.log" Jun 09 11:19:46.808792 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.808750 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm"] Jun 09 11:19:46.821743 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.821707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.825233 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.825202 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm"] Jun 09 11:19:46.870578 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.870471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-sys\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.870578 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.870526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-podres\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.870578 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.870566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-proc\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.870912 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.870646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n54vj\" (UniqueName: \"kubernetes.io/projected/5fd2ba5b-e156-41d0-bdab-6382676b99b3-kube-api-access-n54vj\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.870912 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.870672 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-lib-modules\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971517 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971460 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-proc\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n54vj\" (UniqueName: \"kubernetes.io/projected/5fd2ba5b-e156-41d0-bdab-6382676b99b3-kube-api-access-n54vj\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971741 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-lib-modules\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-sys\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971625 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-proc\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-lib-modules\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-podres\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.971863 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-sys\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.972047 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.971889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5fd2ba5b-e156-41d0-bdab-6382676b99b3-podres\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:46.981318 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:46.981283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n54vj\" (UniqueName: \"kubernetes.io/projected/5fd2ba5b-e156-41d0-bdab-6382676b99b3-kube-api-access-n54vj\") pod \"perf-node-gather-daemonset-ft6vm\" (UID: \"5fd2ba5b-e156-41d0-bdab-6382676b99b3\") " pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:47.151624 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.151558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:47.360465 ip-10-0-132-253 kubenswrapper[2562]: W0609 11:19:47.360420 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5fd2ba5b_e156_41d0_bdab_6382676b99b3.slice/crio-745d58f6e770b9b62c548bdfd9f825ed29e7f35793cafc87b06dedb296e2b1b7 WatchSource:0}: Error finding container 745d58f6e770b9b62c548bdfd9f825ed29e7f35793cafc87b06dedb296e2b1b7: Status 404 returned error can't find the container with id 745d58f6e770b9b62c548bdfd9f825ed29e7f35793cafc87b06dedb296e2b1b7 Jun 09 11:19:47.361164 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.360917 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm"] Jun 09 11:19:47.492991 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.492900 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-hvn5k_0171e4f1-6379-4c6c-b955-ba14b90ec878/volume-data-source-validator/0.log" Jun 09 11:19:47.862299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.862179 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" event={"ID":"5fd2ba5b-e156-41d0-bdab-6382676b99b3","Type":"ContainerStarted","Data":"7de8fa6cd241440285cb28cfa7ba69e700768f8b8fd3a25cace8a563fe582685"} Jun 09 11:19:47.862299 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.862269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" event={"ID":"5fd2ba5b-e156-41d0-bdab-6382676b99b3","Type":"ContainerStarted","Data":"745d58f6e770b9b62c548bdfd9f825ed29e7f35793cafc87b06dedb296e2b1b7"} Jun 09 11:19:47.863218 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.863185 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:47.882343 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:47.882277 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" podStartSLOduration=1.882252406 podStartE2EDuration="1.882252406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:19:47.880104427 +0000 UTC m=+1566.413659506" watchObservedRunningTime="2026-06-09 11:19:47.882252406 +0000 UTC m=+1566.415807487" Jun 09 11:19:48.610715 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:48.610653 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vltf_af36d076-fc63-41fc-9e65-53b0254bb0b4/dns/0.log" Jun 09 11:19:48.633857 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:48.633826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vltf_af36d076-fc63-41fc-9e65-53b0254bb0b4/kube-rbac-proxy/0.log" Jun 09 11:19:48.817651 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:48.817590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v5d2p_a3dc867a-3781-47bf-bb81-47ee2896dcee/dns-node-resolver/0.log" Jun 09 11:19:49.370976 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:49.370939 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d8988757b-wlgp8_6762a267-3a19-4494-b825-5854576af13d/registry/0.log" Jun 09 11:19:49.376491 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:49.376461 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6d8988757b-wlgp8_6762a267-3a19-4494-b825-5854576af13d/registry/1.log" Jun 09 11:19:49.397870 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:49.397841 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-52lmc_fd4067ca-255e-4b08-8261-7d6ed46fda30/node-ca/0.log" Jun 09 11:19:50.416980 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:50.416944 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tfdd5_635127a6-8601-4d8b-b72c-793f7ffe972c/istio-proxy/0.log" Jun 09 11:19:50.581940 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:50.581895 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/0.log" Jun 09 11:19:50.606587 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:50.606550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/1.log" Jun 09 11:19:50.702497 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:50.702385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754456dd49-6xrfv_741fb71d-fff7-4a65-b5e1-15ae31bf9c12/router/0.log" Jun 09 11:19:51.310369 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:51.310333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7mk6z_f2c2212d-1617-4d3e-8a99-ce0ce1ed74a0/serve-healthcheck-canary/0.log" Jun 09 11:19:51.906539 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:51.906475 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9frhh_f3a18652-23de-4d22-9152-71cdc8d581de/kube-rbac-proxy/0.log" Jun 09 11:19:51.930967 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:51.930940 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9frhh_f3a18652-23de-4d22-9152-71cdc8d581de/exporter/0.log" Jun 09 11:19:51.956633 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:51.956576 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9frhh_f3a18652-23de-4d22-9152-71cdc8d581de/extractor/0.log" Jun 09 11:19:54.422052 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.422022 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-86df8c8b8b-tx8qn_e55c90a8-dd15-40fb-aa04-1a21f14b8fd0/nginx/0.log" Jun 09 11:19:54.575802 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.575766 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683395-2dg2w_fae743cc-2c02-41ab-b1ee-ac6d63a9aae6/cleanup/0.log" Jun 09 11:19:54.621544 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.621510 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69b588cdd-24c88_c62be25f-2c26-42d1-856d-9730b4354bbc/manager/0.log" Jun 09 11:19:54.643788 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.643759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-w4lrc_a07ea475-389c-4ee6-bd4f-68e20e64ad40/server/0.log" Jun 09 11:19:54.709276 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.709190 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tmr64_a57bb5c4-16df-43ae-90a6-1b208f4b4860/manager/0.log" Jun 09 11:19:54.741312 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.741283 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-jd4mt_9f144f0a-6e47-4703-a879-6149089f54bc/manager/0.log" Jun 09 11:19:54.764251 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.764222 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d4c99d649-jd4mt_9f144f0a-6e47-4703-a879-6149089f54bc/copy-manifests/0.log" Jun 09 11:19:54.888874 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.888837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8zbsl/perf-node-gather-daemonset-ft6vm" Jun 09 11:19:54.941405 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:54.941356 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-25mnl_b937cd18-47fc-4365-9742-47fc036e9546/postgres/0.log" Jun 09 11:19:56.720253 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:19:56.720214 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7fd99f789d-2vgnp_3913e681-66ca-484e-8f47-457068cfeb0f/manager/0.log" Jun 09 11:20:01.505223 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:01.505190 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tfdd5_635127a6-8601-4d8b-b72c-793f7ffe972c/istio-proxy/0.log" Jun 09 11:20:01.627185 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:01.627131 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/0.log" Jun 09 11:20:01.651990 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:01.651957 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/1.log" Jun 09 11:20:01.722309 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:01.722278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754456dd49-6xrfv_741fb71d-fff7-4a65-b5e1-15ae31bf9c12/router/0.log" Jun 09 11:20:02.888927 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:02.888883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tfdd5_635127a6-8601-4d8b-b72c-793f7ffe972c/istio-proxy/0.log" Jun 09 11:20:03.023337 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:03.023305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/0.log" Jun 09 11:20:03.045114 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:03.045080 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/1.log" Jun 09 11:20:03.063774 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:03.063734 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2b68l_a078ff6a-217c-4872-8c66-033d64348007/konnectivity-agent/0.log" limit=1024 Jun 09 11:20:03.137385 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:03.137332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754456dd49-6xrfv_741fb71d-fff7-4a65-b5e1-15ae31bf9c12/router/0.log" Jun 09 11:20:04.581681 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.581649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/kube-multus-additional-cni-plugins/0.log" Jun 09 11:20:04.604338 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.604299 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/egress-router-binary-copy/0.log" Jun 09 11:20:04.627409 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.627378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/cni-plugins/0.log" Jun 09 11:20:04.652620 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.652575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/bond-cni-plugin/0.log" Jun 09 11:20:04.675580 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.675473 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/routeoverride-cni/0.log" Jun 09 11:20:04.698393 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.698361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/whereabouts-cni-bincopy/0.log" Jun 09 11:20:04.720805 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.720766 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v9snq_383e5937-c0dd-4aed-854e-0f2d0aeb54f6/whereabouts-cni/0.log" Jun 09 11:20:04.724135 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.724112 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795tfdd5_635127a6-8601-4d8b-b72c-793f7ffe972c/istio-proxy/0.log" Jun 09 11:20:04.821242 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.821210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nzzd5_84c68892-e535-4ac8-830c-ebbbdf45b576/kube-multus/0.log" Jun 09 11:20:04.844415 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.844378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/0.log" Jun 09 11:20:04.844990 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.844960 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-68ngr_fbe71c5d-3b91-4888-bbfe-f207c6f8bf54/network-metrics-daemon/0.log" Jun 09 11:20:04.867200 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.867160 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-z8cvc_9358cdb4-09f2-4563-a7d1-3a7a1c6f5329/istio-proxy/1.log" Jun 09 11:20:04.868202 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.868133 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-68ngr_fbe71c5d-3b91-4888-bbfe-f207c6f8bf54/kube-rbac-proxy/0.log" Jun 09 11:20:04.933924 ip-10-0-132-253 kubenswrapper[2562]: I0609 11:20:04.933825 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-754456dd49-6xrfv_741fb71d-fff7-4a65-b5e1-15ae31bf9c12/router/0.log"