Jun 15 02:28:29.488282 ip-10-0-140-24 systemd[1]: Starting Kubernetes Kubelet... Jun 15 02:28:29.908777 ip-10-0-140-24 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 02:28:29.908777 ip-10-0-140-24 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 02:28:29.908777 ip-10-0-140-24 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 02:28:29.908777 ip-10-0-140-24 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 02:28:29.908777 ip-10-0-140-24 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 02:28:29.909435 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.908806 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 02:28:29.912376 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912361 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 02:28:29.912376 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912377 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912381 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912384 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912387 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912390 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912393 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912395 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912398 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912400 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912403 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912405 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912408 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912410 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912413 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912418 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912422 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912424 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912427 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912434 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912437 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 02:28:29.912445 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912440 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912442 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912444 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912447 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912450 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912453 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912455 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912458 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912462 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912466 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912469 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912471 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912475 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912479 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912481 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912484 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912487 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912489 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912492 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 02:28:29.912931 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912494 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912497 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912499 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912502 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912504 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912506 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912509 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912511 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912514 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912517 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912520 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912522 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912525 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912527 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912529 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912532 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912535 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912537 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912540 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912542 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 02:28:29.913413 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912544 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912547 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912550 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912552 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912555 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912557 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912559 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912562 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912564 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912567 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912569 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912572 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912574 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912577 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912580 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912582 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912584 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912587 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912590 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912592 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 02:28:29.913939 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912595 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912597 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912600 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912603 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912605 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912608 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912612 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912615 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912617 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912620 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912622 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912625 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912627 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912631 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912633 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912636 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912638 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912641 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.912643 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914400 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914407 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 02:28:29.914438 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914411 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914415 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914419 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914423 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914427 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914430 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914433 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914435 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914438 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914440 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914443 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914446 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914449 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914451 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914454 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914456 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914459 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914462 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914464 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 02:28:29.915044 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914467 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914470 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914472 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914475 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914477 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914479 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914482 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914485 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914487 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914489 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914492 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914495 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914497 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914500 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914502 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914506 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914510 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914513 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914516 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914518 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 02:28:29.915509 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914521 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914523 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914526 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914529 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914531 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914534 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914536 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914539 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914541 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914544 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914546 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914548 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914551 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914553 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914556 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914558 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914560 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914563 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914565 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914568 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 02:28:29.916008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914570 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914572 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914575 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914577 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914580 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914582 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914585 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914588 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914590 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914593 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914596 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914598 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914601 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914603 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914606 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914610 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914614 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914617 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914619 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 02:28:29.916496 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914622 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914625 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914629 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914631 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914634 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914637 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914639 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914642 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914644 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914647 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914649 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914652 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914654 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914657 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914668 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914671 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914673 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914676 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.914678 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915094 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 02:28:29.916953 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915101 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915105 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915108 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915111 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915114 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915117 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915120 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915122 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915125 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915127 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915129 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915132 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915134 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915137 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915139 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915142 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915144 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915148 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915151 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 02:28:29.917450 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915154 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915158 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915161 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915163 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915166 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915168 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915171 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915174 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915176 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915179 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915182 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915185 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915187 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915190 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915193 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915195 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915198 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915201 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915203 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915207 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 02:28:29.917936 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915210 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915212 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915214 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915218 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915220 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915223 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915225 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915228 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915230 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915232 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915235 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915237 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915240 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915242 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915244 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915248 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915251 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915255 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915258 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 02:28:29.918482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915260 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915263 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915265 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915268 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915270 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915272 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915275 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915278 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915280 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915283 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915285 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915288 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915290 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915293 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915295 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915298 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915300 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915303 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915305 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915307 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915310 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 02:28:29.918938 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915312 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915314 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915317 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915319 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915322 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915324 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915327 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915329 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915332 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915334 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915336 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915339 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915341 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915343 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915346 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915348 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915351 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915354 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.915356 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915428 2559 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915434 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 02:28:29.919453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915440 2559 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915444 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915449 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915452 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915456 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915460 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915464 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915466 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915469 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915472 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915475 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915478 2559 flags.go:64] FLAG: --cgroup-root="" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915481 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915484 2559 flags.go:64] FLAG: --client-ca-file="" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915487 2559 flags.go:64] FLAG: --cloud-provider="external" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915490 2559 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915494 2559 flags.go:64] FLAG: --cluster-domain="" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915497 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915500 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915502 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915506 2559 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915510 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915513 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915516 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 02:28:29.919942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915519 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915522 2559 flags.go:64] FLAG: --contention-profiling="false" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915524 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915528 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915531 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915534 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915538 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915540 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915543 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915546 2559 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915548 2559 flags.go:64] FLAG: --enable-server="true" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915552 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915556 2559 flags.go:64] FLAG: --event-burst="100" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915559 2559 flags.go:64] FLAG: --event-qps="50" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915561 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915564 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915566 2559 flags.go:64] FLAG: --eviction-hard="" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915570 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915573 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915575 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915578 2559 flags.go:64] FLAG: --eviction-soft="" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915581 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915583 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915586 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915588 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 02:28:29.920527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915591 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915594 2559 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915596 2559 flags.go:64] FLAG: --feature-gates="" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915600 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915603 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915606 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915608 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915611 2559 flags.go:64] FLAG: --healthz-port="10248" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915614 2559 flags.go:64] FLAG: --help="false" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915616 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-140-24.ec2.internal" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915619 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915626 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915629 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915632 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915635 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915638 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915641 2559 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915643 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915646 2559 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915649 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915652 2559 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915655 2559 flags.go:64] FLAG: --kube-reserved="" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915658 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915660 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 02:28:29.921180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915663 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915666 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915669 2559 flags.go:64] FLAG: --lock-file="" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915671 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915674 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915677 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915682 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915684 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915687 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915690 2559 flags.go:64] FLAG: --logging-format="text" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915692 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915696 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915698 2559 flags.go:64] FLAG: --manifest-url="" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915701 2559 flags.go:64] FLAG: --manifest-url-header="" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915705 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915708 2559 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915711 2559 flags.go:64] FLAG: --max-pods="110" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915714 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915717 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915721 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915724 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915727 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915730 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915732 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915739 2559 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 02:28:29.921809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915741 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915744 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915747 2559 flags.go:64] FLAG: --pod-cidr="" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915750 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915755 2559 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915758 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915761 2559 flags.go:64] FLAG: --pods-per-core="0" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915764 2559 flags.go:64] FLAG: --port="10250" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915767 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915769 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02dbc365734a9f919" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915772 2559 flags.go:64] FLAG: --qos-reserved="" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915775 2559 flags.go:64] FLAG: --read-only-port="10255" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915778 2559 flags.go:64] FLAG: --register-node="true" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915780 2559 flags.go:64] FLAG: --register-with-taints="" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915784 2559 flags.go:64] FLAG: --registry-burst="10" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915786 2559 flags.go:64] FLAG: --registry-qps="5" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915789 2559 flags.go:64] FLAG: --reserved-cpus="" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915792 2559 flags.go:64] FLAG: --reserved-memory="" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915795 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915798 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915801 2559 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915804 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915807 2559 flags.go:64] FLAG: --runonce="false" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915810 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915813 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 02:28:29.922469 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915816 2559 flags.go:64] FLAG: --seccomp-default="false" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915819 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915822 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915825 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915828 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915831 2559 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915833 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915836 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915839 2559 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915841 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915844 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915847 2559 flags.go:64] FLAG: --system-cgroups="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915850 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915855 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915858 2559 flags.go:64] FLAG: --tls-cert-file="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915861 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915865 2559 flags.go:64] FLAG: --tls-min-version="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915867 2559 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915870 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915873 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915875 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915878 2559 flags.go:64] FLAG: --v="2" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915882 2559 flags.go:64] FLAG: --version="false" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915886 2559 flags.go:64] FLAG: --vmodule="" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915889 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 02:28:29.923108 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.915894 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916018 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916022 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916026 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916029 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916031 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916034 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916036 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916039 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916043 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916046 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916048 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916051 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916053 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916056 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916058 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916061 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916063 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916066 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916068 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 02:28:29.923706 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916071 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916074 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916077 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916080 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916083 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916086 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916089 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916091 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916093 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916096 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916098 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916101 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916104 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916107 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916109 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916112 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916114 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916117 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916119 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916122 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 02:28:29.924210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916124 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916128 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916131 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916133 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916137 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916140 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916143 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916146 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916148 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916151 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916153 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916156 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916159 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916161 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916164 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916166 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916168 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916171 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916174 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916176 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 02:28:29.924694 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916179 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916181 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916184 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916187 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916193 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916196 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916198 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916201 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916203 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916206 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916208 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916210 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916213 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916217 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916219 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916222 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916224 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916227 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916229 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916231 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 02:28:29.925191 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916235 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916239 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916241 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916244 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916247 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916250 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916253 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916256 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916259 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916261 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916265 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916267 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916270 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916272 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916275 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916277 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916281 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916283 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916286 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 02:28:29.925680 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.916288 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.916855 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.923825 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.923839 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.923854 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.923863 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923931 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923936 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923940 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923942 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923945 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923948 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923950 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923953 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923956 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 02:28:29.926171 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923958 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923961 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923963 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923971 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923974 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923977 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923979 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.923982 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924002 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924005 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924008 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924011 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924013 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924016 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924018 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924020 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924023 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924026 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924028 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924030 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 02:28:29.926547 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924034 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924038 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924042 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924044 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924047 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924049 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924052 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924055 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924057 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924059 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924062 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924065 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924067 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924070 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924072 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924075 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924084 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924087 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924089 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924091 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 02:28:29.927069 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924094 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924096 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924099 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924101 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924103 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924106 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924108 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924112 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924115 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924118 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924121 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924123 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924126 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924129 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924131 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924133 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924136 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924138 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924141 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924143 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 02:28:29.927581 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924146 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924148 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924150 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924153 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924156 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924159 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924161 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924163 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924165 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924173 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924176 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924178 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924181 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924183 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924185 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924188 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924190 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924192 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924195 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 02:28:29.928081 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924197 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924199 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924202 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924204 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924206 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924210 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924212 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924216 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924220 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924223 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924226 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.924231 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924374 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924378 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924381 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 02:28:29.928542 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924383 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924386 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924389 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924392 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924395 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924398 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924400 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924403 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924411 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924414 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924417 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924419 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924422 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924424 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924427 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924430 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924432 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924436 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924439 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 02:28:29.928928 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924442 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924445 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924447 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924450 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924453 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924455 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924458 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924460 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924462 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924465 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924467 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924470 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924472 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924474 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924477 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924479 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924481 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924484 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924486 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924488 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 02:28:29.929400 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924491 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924493 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924501 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924504 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924506 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924508 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924511 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924513 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924515 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924518 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924521 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924525 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924527 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924530 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924532 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924535 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924538 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924540 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924543 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924545 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 02:28:29.929894 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924547 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924550 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924552 2559 feature_gate.go:328] unrecognized feature gate: Example Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924554 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924557 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924559 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924561 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924564 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924566 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924568 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924570 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924573 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924575 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924577 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924579 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924587 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924590 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924592 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924595 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924597 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 02:28:29.930393 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924608 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924611 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924613 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924616 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924618 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924620 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924623 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924625 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924628 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924630 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924633 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924635 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924639 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924642 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924645 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924647 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 02:28:29.930909 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:29.924649 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 02:28:29.931311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.924654 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 02:28:29.931311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.924753 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 02:28:29.931311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.928598 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 02:28:29.931311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.930172 2559 server.go:1019] "Starting client certificate rotation" Jun 15 02:28:29.931311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.930270 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 02:28:29.931311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.930306 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 02:28:29.935522 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.935494 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 02:28:29.937383 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.937363 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 02:28:29.952475 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.952455 2559 log.go:25] "Validated CRI v1 runtime API" Jun 15 02:28:29.956385 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.956369 2559 log.go:25] "Validated CRI v1 image API" Jun 15 02:28:29.957311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.957296 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 02:28:29.960147 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.960126 2559 fs.go:135] Filesystem UUIDs: map[6ff77a89-761b-4de8-ac18-79383d38c50f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b9a89384-05c6-4652-9bc8-ae0decb59361:/dev/nvme0n1p3] Jun 15 02:28:29.960215 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.960147 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 02:28:29.963611 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.963594 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 02:28:29.965438 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.965331 2559 manager.go:216] Machine: {Timestamp:2026-06-15 02:28:29.963737659 +0000 UTC m=+0.349660260 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093928 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23a02b95d13668795ac3117271d699 SystemUUID:ec23a02b-95d1-3668-795a-c3117271d699 BootID:4cb581b8-c587-4d3d-96ae-a498c8dad39a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f5:89:10:4d:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f5:89:10:4d:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:1b:fb:be:a0:fd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 02:28:29.965438 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.965434 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 02:28:29.965546 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.965529 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 02:28:29.968429 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.968403 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 02:28:29.968561 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.968432 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-24.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 02:28:29.969132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.969122 2559 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 02:28:29.969168 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.969136 2559 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 02:28:29.969168 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.969143 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 02:28:29.969816 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.969799 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 02:28:29.971151 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.971142 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 02:28:29.974015 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974002 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 15 02:28:29.974126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974116 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 02:28:29.974164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974146 2559 kubelet.go:486] "Attempting to sync node with API server" Jun 15 02:28:29.974164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974156 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 02:28:29.974232 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974169 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 02:28:29.974232 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974180 2559 kubelet.go:398] "Adding apiserver pod source" Jun 15 02:28:29.974232 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974188 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 02:28:29.974562 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974548 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 02:28:29.974617 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.974576 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 02:28:29.979907 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.979884 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 02:28:29.980057 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.980042 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kntw" Jun 15 02:28:29.981298 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981283 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 02:28:29.981386 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981321 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 02:28:29.981515 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981501 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 02:28:29.981586 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981523 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 02:28:29.981586 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981533 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 02:28:29.981586 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981555 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 02:28:29.981586 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981568 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 02:28:29.981586 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.981577 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 02:28:29.982026 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.982015 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 02:28:29.982086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.982028 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 02:28:29.982086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.982038 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 02:28:29.982086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.982046 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 02:28:29.982086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.982068 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 02:28:29.982086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.982080 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 02:28:29.983022 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.983011 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 02:28:29.983093 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.983024 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 02:28:29.990693 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.990582 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6kntw" Jun 15 02:28:29.992390 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.992368 2559 server.go:1268] "Started kubelet" Jun 15 02:28:29.992580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.992495 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 02:28:29.996021 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.995976 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 02:28:29.996140 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.995687 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 02:28:29.996451 ip-10-0-140-24 systemd[1]: Started Kubernetes Kubelet. Jun 15 02:28:29.997581 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:29.997558 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-24.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 02:28:29.997669 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:29.997643 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 02:28:29.997983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.997967 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-24.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 02:28:29.998424 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:29.998411 2559 server.go:310] "Adding debug handlers to kubelet server" Jun 15 02:28:30.000675 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.000656 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 02:28:30.003640 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.003620 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 02:28:30.006341 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.006326 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 02:28:30.006433 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.006326 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 02:28:30.006433 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.006422 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.007096 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.006875 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 02:28:30.007096 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.006878 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 02:28:30.007096 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007082 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 02:28:30.007274 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007159 2559 factory.go:55] Registering systemd factory Jun 15 02:28:30.007274 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007178 2559 factory.go:223] Registration of the systemd container factory successfully Jun 15 02:28:30.007404 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007389 2559 reconstruct.go:97] "Volume reconstruction finished" Jun 15 02:28:30.007466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007406 2559 reconciler.go:29] "Reconciler: start to sync state" Jun 15 02:28:30.007466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007412 2559 factory.go:153] Registering CRI-O factory Jun 15 02:28:30.007466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007429 2559 factory.go:223] Registration of the crio container factory successfully Jun 15 02:28:30.007598 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007532 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 02:28:30.007598 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007555 2559 factory.go:103] Registering Raw factory Jun 15 02:28:30.007598 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007569 2559 manager.go:1196] Started watching for new ooms in manager Jun 15 02:28:30.007953 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.007937 2559 manager.go:349] Starting recovery of all containers Jun 15 02:28:30.009732 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.009711 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:30.012728 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.012708 2559 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-24.ec2.internal\" not found" node="ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.019022 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.018011 2559 manager.go:354] Recovery completed Jun 15 02:28:30.021443 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.021415 2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 15 02:28:30.024743 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.024729 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.026446 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.026429 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.026533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.026463 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.026533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.026477 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.027027 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027011 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 02:28:30.027027 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027023 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.027027 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027026 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 02:28:30.027183 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027045 2559 state_mem.go:36] "Initialized new in-memory state store" Jun 15 02:28:30.027628 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027616 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.027676 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027638 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.027676 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.027646 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.028361 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.028348 2559 policy_none.go:49] "None policy: Start" Jun 15 02:28:30.028418 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.028367 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 02:28:30.028418 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.028379 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 02:28:30.029490 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.029478 2559 policy_none.go:47] "Start" Jun 15 02:28:30.068598 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.068584 2559 manager.go:337] "Starting Device Plugin manager" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.068653 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.068664 2559 server.go:87] "Starting device plugin registration server" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.068877 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.068894 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.068965 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.069061 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.069072 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.069563 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.069603 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.078053 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.079290 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.079323 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.079339 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.079369 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 02:28:30.082497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.081420 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:30.169681 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.169608 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.171152 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.171137 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.171241 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.171166 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.171241 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.171193 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.171241 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.171219 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.179931 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.179915 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.179983 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.179935 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-24.ec2.internal\": node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.180041 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.180029 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal"] Jun 15 02:28:30.180090 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.180081 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.180803 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.180791 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.180854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.180827 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.180854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.180838 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.182153 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182141 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.182261 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182249 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.182312 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182275 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.182931 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182915 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.182931 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182929 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.183094 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182956 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.183094 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182959 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.183094 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182970 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.183094 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.182974 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.184300 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.184283 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.184381 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.184317 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 02:28:30.184949 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.184935 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientMemory" Jun 15 02:28:30.185058 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.184963 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 02:28:30.185058 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.184976 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeHasSufficientPID" Jun 15 02:28:30.194365 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.194350 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.219707 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.219684 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-24.ec2.internal\" not found" node="ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.224321 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.224305 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-24.ec2.internal\" not found" node="ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.295087 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.295059 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.308142 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.308117 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07d71d30e11b1174ec8829e08a2d8881-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"07d71d30e11b1174ec8829e08a2d8881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.308248 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.308142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07d71d30e11b1174ec8829e08a2d8881-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"07d71d30e11b1174ec8829e08a2d8881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.308248 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.308163 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/872c428ced8b45607624266cca564b27-config\") pod \"kube-apiserver-proxy-ip-10-0-140-24.ec2.internal\" (UID: \"872c428ced8b45607624266cca564b27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.395912 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.395886 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.409240 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.409218 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07d71d30e11b1174ec8829e08a2d8881-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"07d71d30e11b1174ec8829e08a2d8881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.409299 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.409271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/07d71d30e11b1174ec8829e08a2d8881-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"07d71d30e11b1174ec8829e08a2d8881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.409343 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.409326 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07d71d30e11b1174ec8829e08a2d8881-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"07d71d30e11b1174ec8829e08a2d8881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.409392 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.409353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/872c428ced8b45607624266cca564b27-config\") pod \"kube-apiserver-proxy-ip-10-0-140-24.ec2.internal\" (UID: \"872c428ced8b45607624266cca564b27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.409392 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.409382 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/872c428ced8b45607624266cca564b27-config\") pod \"kube-apiserver-proxy-ip-10-0-140-24.ec2.internal\" (UID: \"872c428ced8b45607624266cca564b27\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.409453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.409383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/07d71d30e11b1174ec8829e08a2d8881-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal\" (UID: \"07d71d30e11b1174ec8829e08a2d8881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.496713 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.496638 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.522115 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.522093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.528142 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.528118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Jun 15 02:28:30.597336 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.597304 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.697838 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.697814 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.798439 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.798362 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.899012 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.898965 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:30.906146 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.906125 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:30.929282 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.929255 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 02:28:30.929920 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.929382 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 02:28:30.929920 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.929415 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 02:28:30.929920 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.929422 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 02:28:30.956398 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:30.956362 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872c428ced8b45607624266cca564b27.slice/crio-f37ac5a33f56780b1b653b82c140f562e8ab94590ac6f810d05252a7bea3130f WatchSource:0}: Error finding container f37ac5a33f56780b1b653b82c140f562e8ab94590ac6f810d05252a7bea3130f: Status 404 returned error can't find the container with id f37ac5a33f56780b1b653b82c140f562e8ab94590ac6f810d05252a7bea3130f Jun 15 02:28:30.956568 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:30.956553 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d71d30e11b1174ec8829e08a2d8881.slice/crio-8ea25a9c83c196cdf4d2794f6929788c6bca0ff5404bae28f762728c607d4d57 WatchSource:0}: Error finding container 8ea25a9c83c196cdf4d2794f6929788c6bca0ff5404bae28f762728c607d4d57: Status 404 returned error can't find the container with id 8ea25a9c83c196cdf4d2794f6929788c6bca0ff5404bae28f762728c607d4d57 Jun 15 02:28:30.962575 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.962559 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:28:30.996750 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.996712 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 02:23:29 +0000 UTC" deadline="2028-02-19 20:41:16.119606202 +0000 UTC" Jun 15 02:28:30.996750 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:30.996748 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14754h12m45.122862244s" Jun 15 02:28:30.999947 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:30.999933 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-24.ec2.internal\" not found" Jun 15 02:28:31.079571 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.079479 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:31.082660 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.082607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" event={"ID":"07d71d30e11b1174ec8829e08a2d8881","Type":"ContainerStarted","Data":"8ea25a9c83c196cdf4d2794f6929788c6bca0ff5404bae28f762728c607d4d57"} Jun 15 02:28:31.083721 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.083700 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" event={"ID":"872c428ced8b45607624266cca564b27","Type":"ContainerStarted","Data":"f37ac5a33f56780b1b653b82c140f562e8ab94590ac6f810d05252a7bea3130f"} Jun 15 02:28:31.107705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.107684 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" Jun 15 02:28:31.121000 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.120969 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 02:28:31.121962 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.121949 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" Jun 15 02:28:31.130548 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.130532 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 02:28:31.974976 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.974941 2559 apiserver.go:52] "Watching apiserver" Jun 15 02:28:31.985534 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.985510 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 02:28:31.985952 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.985922 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8jmwp","openshift-image-registry/node-ca-2g55p","openshift-multus/multus-additional-cni-plugins-wg2lk","openshift-multus/network-metrics-daemon-nx5lh","openshift-network-operator/iptables-alerter-nm6r2","kube-system/konnectivity-agent-j5h7n","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv","openshift-dns/node-resolver-74mjb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal","openshift-multus/multus-5wp2f","openshift-network-diagnostics/network-check-target-b7d4h","openshift-ovn-kubernetes/ovnkube-node-h6h8k","kube-system/global-pull-secret-syncer-pkxlc"] Jun 15 02:28:31.987538 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.987512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:31.988634 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.988615 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:31.989670 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.989647 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:31.990526 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.990499 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6xrlf\"" Jun 15 02:28:31.990634 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.990504 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 02:28:31.990769 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.990752 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:31.991907 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.991887 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:31.991907 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.991901 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 02:28:31.992077 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:31.992004 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:31.993192 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.993171 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 02:28:31.993628 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.993611 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 02:28:31.993714 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.993616 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 02:28:31.994101 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.994081 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:31.994544 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.994521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 02:28:31.994634 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.994549 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 02:28:31.994634 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.994573 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 02:28:31.994712 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.994533 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 02:28:31.994854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.994834 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 02:28:31.995056 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995040 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995293 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995329 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995339 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995355 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fmfnv\"" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995358 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bv4sn\"" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995639 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 02:28:31.995823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.995735 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 02:28:31.996839 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.996642 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:31.996839 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.996825 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bf2kz\"" Jun 15 02:28:31.996968 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.996911 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 02:28:31.997070 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.997052 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:28:31.997169 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:31.997132 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:31.997482 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.997453 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 02:28:31.997835 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.997809 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 02:28:31.998024 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.998009 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:31.998350 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.998318 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 02:28:31.998524 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.998500 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 02:28:31.999411 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.999393 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5kmfn\"" Jun 15 02:28:31.999665 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:31.999640 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xkflz\"" Jun 15 02:28:32.000528 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.000505 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:28:32.000840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.000822 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 02:28:32.000928 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.000833 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.001076 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.001058 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-htb2v\"" Jun 15 02:28:32.003430 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.003411 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 02:28:32.003721 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.003695 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 02:28:32.003721 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.003712 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.003820 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.003776 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nx76n\"" Jun 15 02:28:32.003866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.003715 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 02:28:32.004876 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.004857 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:32.004976 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.004915 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:32.006184 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.006167 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 02:28:32.006281 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.006267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8jnpj\"" Jun 15 02:28:32.007704 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.007672 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 02:28:32.008039 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.008019 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 02:28:32.017349 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-device-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.017451 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-var-lib-kubelet\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.017451 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.017451 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b67p5\" (UniqueName: \"kubernetes.io/projected/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-kube-api-access-b67p5\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.017601 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017461 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-slash\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.017601 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017569 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.017682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017604 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-cnibin\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.017682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91bf03f-16e1-411c-b9db-8b62eb75e90f-tmp\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.017682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017664 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.017818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017689 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-system-cni-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.017818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017724 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-cni-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.017818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017760 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-netns\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.017818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017786 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-cni-bin\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-run-ovn-kubernetes\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017865 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-cni-netd\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5c5614d-4794-4df3-af7a-34ebe4400e66-host-slash\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.017915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-daemon-config\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018021 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-cni-bin\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/409968b6-a03b-4caf-b7df-e03d50603795-hosts-file\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.018086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysctl-conf\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-hostroot\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p28fb\" (UniqueName: \"kubernetes.io/projected/a6281af0-9f59-4120-a4cb-4657c20b7a76-kube-api-access-p28fb\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018129 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/622691a5-4cab-449f-9e46-79aa9c1ce23f-serviceca\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018142 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-os-release\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018157 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzg9\" (UniqueName: \"kubernetes.io/projected/409968b6-a03b-4caf-b7df-e03d50603795-kube-api-access-kpzg9\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018174 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysconfig\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-systemd\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018254 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-conf-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018284 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2k72\" (UniqueName: \"kubernetes.io/projected/f5c5614d-4794-4df3-af7a-34ebe4400e66-kube-api-access-w2k72\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-var-lib-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-cni-binary-copy\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.018377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-sys\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-multus-certs\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-systemd\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/409968b6-a03b-4caf-b7df-e03d50603795-tmp-dir\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018554 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-cni-binary-copy\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018574 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5c5614d-4794-4df3-af7a-34ebe4400e66-iptables-alerter-script\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-socket-dir-parent\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018606 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-k8s-cni-cncf-io\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20b9ad28-1085-466e-9216-b558186923c4-konnectivity-ca\") pod \"konnectivity-agent-j5h7n\" (UID: \"20b9ad28-1085-466e-9216-b558186923c4\") " pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018650 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-run-netns\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018684 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-etc-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018709 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-tuned\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-cnibin\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.018775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018751 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-etc-kubernetes\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8v72\" (UniqueName: \"kubernetes.io/projected/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-kube-api-access-k8v72\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018843 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20b9ad28-1085-466e-9216-b558186923c4-agent-certs\") pod \"konnectivity-agent-j5h7n\" (UID: \"20b9ad28-1085-466e-9216-b558186923c4\") " pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-kubelet\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018921 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-ovn\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovn-node-metrics-cert\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.018977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/271f66fd-aa03-478a-b5f4-389e9b318d91-dbus\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovnkube-script-lib\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5cqj\" (UniqueName: \"kubernetes.io/projected/622691a5-4cab-449f-9e46-79aa9c1ce23f-kube-api-access-w5cqj\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-system-cni-dir\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019111 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2v7q\" (UniqueName: \"kubernetes.io/projected/d91bf03f-16e1-411c-b9db-8b62eb75e90f-kube-api-access-j2v7q\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-systemd-units\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovnkube-config\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-kubernetes\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlxz\" (UniqueName: \"kubernetes.io/projected/8852e474-0727-45d4-93c0-67ea29e0fe6a-kube-api-access-jwlxz\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-sys-fs\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-node-log\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019295 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7lc\" (UniqueName: \"kubernetes.io/projected/5c56b7e5-5839-4895-8676-ed17893e8f47-kube-api-access-kj7lc\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019322 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-modprobe-d\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-run\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-lib-modules\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-host\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/271f66fd-aa03-478a-b5f4-389e9b318d91-kubelet-config\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-registration-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-os-release\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019533 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-log-socket\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019558 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-env-overrides\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysctl-d\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.019840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-socket-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.020305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-cni-multus\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.020305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-kubelet\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.020305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019729 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/622691a5-4cab-449f-9e46-79aa9c1ce23f-host\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.020305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.019786 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 02:28:32.040238 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.040219 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-thrg2" Jun 15 02:28:32.049222 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.049206 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-thrg2" Jun 15 02:28:32.120565 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-var-lib-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.120719 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-cni-binary-copy\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.120719 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120603 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.120719 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120626 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-sys\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.120858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-multus-certs\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.120858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120812 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-systemd\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.120858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120834 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.120948 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120884 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-multus-certs\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.120948 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/409968b6-a03b-4caf-b7df-e03d50603795-tmp-dir\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.121041 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-cni-binary-copy\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121041 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.120984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5c5614d-4794-4df3-af7a-34ebe4400e66-iptables-alerter-script\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.121041 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121028 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-socket-dir-parent\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121178 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-k8s-cni-cncf-io\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121178 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20b9ad28-1085-466e-9216-b558186923c4-konnectivity-ca\") pod \"konnectivity-agent-j5h7n\" (UID: \"20b9ad28-1085-466e-9216-b558186923c4\") " pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.121178 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-run-netns\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121178 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121130 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-etc-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121178 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-tuned\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.121178 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-cnibin\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121199 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-etc-kubernetes\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121219 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-cni-binary-copy\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121218 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121258 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-k8s-cni-cncf-io\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-systemd\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121272 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c56b7e5-5839-4895-8676-ed17893e8f47-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-run-netns\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-etc-kubernetes\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121353 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-cnibin\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121362 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-sys\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.121453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-socket-dir-parent\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121467 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121621 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/409968b6-a03b-4caf-b7df-e03d50603795-tmp-dir\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8v72\" (UniqueName: \"kubernetes.io/projected/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-kube-api-access-k8v72\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121682 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121694 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20b9ad28-1085-466e-9216-b558186923c4-konnectivity-ca\") pod \"konnectivity-agent-j5h7n\" (UID: \"20b9ad28-1085-466e-9216-b558186923c4\") " pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121704 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20b9ad28-1085-466e-9216-b558186923c4-agent-certs\") pod \"konnectivity-agent-j5h7n\" (UID: \"20b9ad28-1085-466e-9216-b558186923c4\") " pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-kubelet\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-ovn\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121765 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovn-node-metrics-cert\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/271f66fd-aa03-478a-b5f4-389e9b318d91-dbus\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121806 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovnkube-script-lib\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5cqj\" (UniqueName: \"kubernetes.io/projected/622691a5-4cab-449f-9e46-79aa9c1ce23f-kube-api-access-w5cqj\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-system-cni-dir\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2v7q\" (UniqueName: \"kubernetes.io/projected/d91bf03f-16e1-411c-b9db-8b62eb75e90f-kube-api-access-j2v7q\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121872 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-cni-binary-copy\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121901 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-systemd-units\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.121973 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovnkube-config\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f5c5614d-4794-4df3-af7a-34ebe4400e66-iptables-alerter-script\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121947 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-etc-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-kubernetes\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.121970 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-kubernetes\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122008 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122008 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlxz\" (UniqueName: \"kubernetes.io/projected/8852e474-0727-45d4-93c0-67ea29e0fe6a-kube-api-access-jwlxz\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122044 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-sys-fs\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122139 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-system-cni-dir\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122225 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-kubelet\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovnkube-script-lib\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-systemd-units\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122613 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-node-log\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122683 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-run-ovn\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122783 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7lc\" (UniqueName: \"kubernetes.io/projected/5c56b7e5-5839-4895-8676-ed17893e8f47-kube-api-access-kj7lc\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-modprobe-d\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovnkube-config\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.122866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-run\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-run\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-sys-fs\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-var-lib-openvswitch\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-node-log\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.122952 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/271f66fd-aa03-478a-b5f4-389e9b318d91-dbus\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123061 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-modprobe-d\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123052 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-lib-modules\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-host\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/271f66fd-aa03-478a-b5f4-389e9b318d91-kubelet-config\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123173 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-lib-modules\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123190 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-host\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-registration-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123230 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-registration-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123233 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-os-release\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123273 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-etc-selinux\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123233 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/271f66fd-aa03-478a-b5f4-389e9b318d91-kubelet-config\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.123580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123283 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-log-socket\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.124301 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-env-overrides\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.124301 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-log-socket\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.124301 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.124301 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123373 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-os-release\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.124489 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.124450 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.130036 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.123420 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysctl-d\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.130149 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130066 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-socket-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.130149 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130136 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-cni-multus\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130230 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-kubelet\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130230 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130203 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/622691a5-4cab-449f-9e46-79aa9c1ce23f-host\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.130304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-device-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.130304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-var-lib-kubelet\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.130304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130293 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.130402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b67p5\" (UniqueName: \"kubernetes.io/projected/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-kube-api-access-b67p5\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.130402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-slash\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130397 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6281af0-9f59-4120-a4cb-4657c20b7a76-ovn-node-metrics-cert\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130415 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-cnibin\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.130499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130446 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91bf03f-16e1-411c-b9db-8b62eb75e90f-tmp\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.130499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.130623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-system-cni-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130531 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-cni-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-netns\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-cni-bin\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130638 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-run-ovn-kubernetes\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130665 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-cni-netd\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5c5614d-4794-4df3-af7a-34ebe4400e66-host-slash\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-daemon-config\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130752 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6281af0-9f59-4120-a4cb-4657c20b7a76-env-overrides\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130760 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-cni-bin\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.130800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130789 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/409968b6-a03b-4caf-b7df-e03d50603795-hosts-file\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysctl-conf\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-hostroot\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p28fb\" (UniqueName: \"kubernetes.io/projected/a6281af0-9f59-4120-a4cb-4657c20b7a76-kube-api-access-p28fb\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130918 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-tuned\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/622691a5-4cab-449f-9e46-79aa9c1ce23f-serviceca\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130970 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-os-release\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzg9\" (UniqueName: \"kubernetes.io/projected/409968b6-a03b-4caf-b7df-e03d50603795-kube-api-access-kpzg9\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysconfig\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-systemd\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.131116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131114 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:32.131518 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131145 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-conf-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.131518 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2k72\" (UniqueName: \"kubernetes.io/projected/f5c5614d-4794-4df3-af7a-34ebe4400e66-kube-api-access-w2k72\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.131518 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131321 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/622691a5-4cab-449f-9e46-79aa9c1ce23f-serviceca\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.131605 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131522 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-os-release\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.131758 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20b9ad28-1085-466e-9216-b558186923c4-agent-certs\") pod \"konnectivity-agent-j5h7n\" (UID: \"20b9ad28-1085-466e-9216-b558186923c4\") " pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.131885 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131865 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-socket-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.131945 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.131876 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:28:32.131945 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.130093 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysctl-d\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.131945 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.131902 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:28:32.131945 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.131916 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:32.132164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.131945 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-cni-multus\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.132164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-kubelet\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.132164 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.132026 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:32.631976161 +0000 UTC m=+3.017898752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:32.132164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132064 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/622691a5-4cab-449f-9e46-79aa9c1ce23f-host\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.132164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-device-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.132164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132135 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-run-netns\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132193 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-run-ovn-kubernetes\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-var-lib-kubelet\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132239 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-host-var-lib-cni-bin\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132256 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132289 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-cni-netd\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-slash\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.132537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c56b7e5-5839-4895-8676-ed17893e8f47-cnibin\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.132960 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132743 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-system-cni-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.132960 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.132749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8v72\" (UniqueName: \"kubernetes.io/projected/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-kube-api-access-k8v72\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.132960 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.132921 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:32.132960 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.132948 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:32.133182 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.133067 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:32.633033078 +0000 UTC m=+3.018955680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:32.133182 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133072 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-systemd\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.133182 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133172 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysconfig\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.133378 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.133274 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:28:32.633239682 +0000 UTC m=+3.019162278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:32.133378 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133284 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-daemon-config\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.133378 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133318 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d91bf03f-16e1-411c-b9db-8b62eb75e90f-etc-sysctl-conf\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.133378 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133345 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f5c5614d-4794-4df3-af7a-34ebe4400e66-host-slash\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.133576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133377 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6281af0-9f59-4120-a4cb-4657c20b7a76-host-cni-bin\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.133576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133413 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-hostroot\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.133576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133487 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/409968b6-a03b-4caf-b7df-e03d50603795-hosts-file\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.133725 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-conf-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.134438 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.133753 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e329d7d1-1c4b-42c3-9bd4-04a042d82d13-multus-cni-dir\") pod \"multus-5wp2f\" (UID: \"e329d7d1-1c4b-42c3-9bd4-04a042d82d13\") " pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.135286 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.135259 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7lc\" (UniqueName: \"kubernetes.io/projected/5c56b7e5-5839-4895-8676-ed17893e8f47-kube-api-access-kj7lc\") pod \"multus-additional-cni-plugins-wg2lk\" (UID: \"5c56b7e5-5839-4895-8676-ed17893e8f47\") " pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.136360 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.136209 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlxz\" (UniqueName: \"kubernetes.io/projected/8852e474-0727-45d4-93c0-67ea29e0fe6a-kube-api-access-jwlxz\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:32.136431 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.136367 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2v7q\" (UniqueName: \"kubernetes.io/projected/d91bf03f-16e1-411c-b9db-8b62eb75e90f-kube-api-access-j2v7q\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.137458 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.137437 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d91bf03f-16e1-411c-b9db-8b62eb75e90f-tmp\") pod \"tuned-8jmwp\" (UID: \"d91bf03f-16e1-411c-b9db-8b62eb75e90f\") " pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.137541 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.137483 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5cqj\" (UniqueName: \"kubernetes.io/projected/622691a5-4cab-449f-9e46-79aa9c1ce23f-kube-api-access-w5cqj\") pod \"node-ca-2g55p\" (UID: \"622691a5-4cab-449f-9e46-79aa9c1ce23f\") " pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.139677 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.139650 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2k72\" (UniqueName: \"kubernetes.io/projected/f5c5614d-4794-4df3-af7a-34ebe4400e66-kube-api-access-w2k72\") pod \"iptables-alerter-nm6r2\" (UID: \"f5c5614d-4794-4df3-af7a-34ebe4400e66\") " pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.139741 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.139654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzg9\" (UniqueName: \"kubernetes.io/projected/409968b6-a03b-4caf-b7df-e03d50603795-kube-api-access-kpzg9\") pod \"node-resolver-74mjb\" (UID: \"409968b6-a03b-4caf-b7df-e03d50603795\") " pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.144118 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.144083 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b67p5\" (UniqueName: \"kubernetes.io/projected/da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6-kube-api-access-b67p5\") pod \"aws-ebs-csi-driver-node-9r2zv\" (UID: \"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.144249 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.144212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p28fb\" (UniqueName: \"kubernetes.io/projected/a6281af0-9f59-4120-a4cb-4657c20b7a76-kube-api-access-p28fb\") pod \"ovnkube-node-h6h8k\" (UID: \"a6281af0-9f59-4120-a4cb-4657c20b7a76\") " pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.301311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.301226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:32.309087 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.309065 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:32.316638 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.316621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2g55p" Jun 15 02:28:32.322031 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.322010 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" Jun 15 02:28:32.329386 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.329368 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nm6r2" Jun 15 02:28:32.336874 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.336854 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-74mjb" Jun 15 02:28:32.342508 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.342485 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" Jun 15 02:28:32.349294 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.349080 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" Jun 15 02:28:32.351951 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.351933 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:32.356224 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.356207 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5wp2f" Jun 15 02:28:32.466198 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.466167 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:32.636088 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.636016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:32.636088 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.636065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:32.636108 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636162 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636202 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636219 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636223 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:28:33.636204386 +0000 UTC m=+4.022126991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636230 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:32.636283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636269 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:32.636589 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636291 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:33.636270705 +0000 UTC m=+4.022193316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:32.636589 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:32.636311 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:33.636299378 +0000 UTC m=+4.022221983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:32.862684 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.862661 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20b9ad28_1085_466e_9216_b558186923c4.slice/crio-af41bdcfe8a12180caa2f46f93f72099e20970cd9efd6e36e3a362eb98545e54 WatchSource:0}: Error finding container af41bdcfe8a12180caa2f46f93f72099e20970cd9efd6e36e3a362eb98545e54: Status 404 returned error can't find the container with id af41bdcfe8a12180caa2f46f93f72099e20970cd9efd6e36e3a362eb98545e54 Jun 15 02:28:32.867024 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.866979 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod409968b6_a03b_4caf_b7df_e03d50603795.slice/crio-0009e9b6494f26bc61eba6b71a3ea0d75c4998c1a4315f3837b20d3cc8ab40da WatchSource:0}: Error finding container 0009e9b6494f26bc61eba6b71a3ea0d75c4998c1a4315f3837b20d3cc8ab40da: Status 404 returned error can't find the container with id 0009e9b6494f26bc61eba6b71a3ea0d75c4998c1a4315f3837b20d3cc8ab40da Jun 15 02:28:32.867482 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.867462 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode329d7d1_1c4b_42c3_9bd4_04a042d82d13.slice/crio-dc3e4a7b109cf9895e62d91e89b3330cbe27c9ebe0f88c994252b8130798860b WatchSource:0}: Error finding container dc3e4a7b109cf9895e62d91e89b3330cbe27c9ebe0f88c994252b8130798860b: Status 404 returned error can't find the container with id dc3e4a7b109cf9895e62d91e89b3330cbe27c9ebe0f88c994252b8130798860b Jun 15 02:28:32.869779 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.868767 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda4aee62_8ac2_4cbe_ae5b_ffb7e7cca4b6.slice/crio-3631845f3d6098e373367eb5751b41b4166980a2a7b08689f21432898f3db01d WatchSource:0}: Error finding container 3631845f3d6098e373367eb5751b41b4166980a2a7b08689f21432898f3db01d: Status 404 returned error can't find the container with id 3631845f3d6098e373367eb5751b41b4166980a2a7b08689f21432898f3db01d Jun 15 02:28:32.869779 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.869568 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c56b7e5_5839_4895_8676_ed17893e8f47.slice/crio-fc6889b731097f149b6a4a138706b08ee1dabae73347af88b0d976629e4f2cef WatchSource:0}: Error finding container fc6889b731097f149b6a4a138706b08ee1dabae73347af88b0d976629e4f2cef: Status 404 returned error can't find the container with id fc6889b731097f149b6a4a138706b08ee1dabae73347af88b0d976629e4f2cef Jun 15 02:28:32.871024 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.870954 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5c5614d_4794_4df3_af7a_34ebe4400e66.slice/crio-511ef19c947f7a32d566f464cc4d8d88c8264c6e120550a272e4a2c8d9f13100 WatchSource:0}: Error finding container 511ef19c947f7a32d566f464cc4d8d88c8264c6e120550a272e4a2c8d9f13100: Status 404 returned error can't find the container with id 511ef19c947f7a32d566f464cc4d8d88c8264c6e120550a272e4a2c8d9f13100 Jun 15 02:28:32.871608 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:28:32.871584 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6281af0_9f59_4120_a4cb_4657c20b7a76.slice/crio-839b81e362fc5d75dd5f839a1ca45ba2c6c8c2f9e27a8d99d3ed15ddd13bc0fc WatchSource:0}: Error finding container 839b81e362fc5d75dd5f839a1ca45ba2c6c8c2f9e27a8d99d3ed15ddd13bc0fc: Status 404 returned error can't find the container with id 839b81e362fc5d75dd5f839a1ca45ba2c6c8c2f9e27a8d99d3ed15ddd13bc0fc Jun 15 02:28:33.051851 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.051798 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 02:23:32 +0000 UTC" deadline="2028-01-19 23:28:55.202243397 +0000 UTC" Jun 15 02:28:33.051851 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.051837 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14013h0m22.15041076s" Jun 15 02:28:33.088046 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.088017 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-74mjb" event={"ID":"409968b6-a03b-4caf-b7df-e03d50603795","Type":"ContainerStarted","Data":"0009e9b6494f26bc61eba6b71a3ea0d75c4998c1a4315f3837b20d3cc8ab40da"} Jun 15 02:28:33.089188 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.089165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5h7n" event={"ID":"20b9ad28-1085-466e-9216-b558186923c4","Type":"ContainerStarted","Data":"af41bdcfe8a12180caa2f46f93f72099e20970cd9efd6e36e3a362eb98545e54"} Jun 15 02:28:33.090367 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.090225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2g55p" event={"ID":"622691a5-4cab-449f-9e46-79aa9c1ce23f","Type":"ContainerStarted","Data":"86e6d888e6993bad215063c5bc239f9eebe2d4860303f18a9983a2621c7c1dc2"} Jun 15 02:28:33.092114 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.092092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" event={"ID":"872c428ced8b45607624266cca564b27","Type":"ContainerStarted","Data":"d0827e1fe17d17af266aab5284153d531067aba3689b7e07e86ea5df0bbb63f2"} Jun 15 02:28:33.093225 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.093198 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" event={"ID":"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6","Type":"ContainerStarted","Data":"3631845f3d6098e373367eb5751b41b4166980a2a7b08689f21432898f3db01d"} Jun 15 02:28:33.094304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.094282 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5wp2f" event={"ID":"e329d7d1-1c4b-42c3-9bd4-04a042d82d13","Type":"ContainerStarted","Data":"dc3e4a7b109cf9895e62d91e89b3330cbe27c9ebe0f88c994252b8130798860b"} Jun 15 02:28:33.095338 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.095314 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" event={"ID":"d91bf03f-16e1-411c-b9db-8b62eb75e90f","Type":"ContainerStarted","Data":"d699c0ec4c2fe5c1b30612ac21694310d67461834f93b3724a327b8703a49f78"} Jun 15 02:28:33.096426 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.096368 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"839b81e362fc5d75dd5f839a1ca45ba2c6c8c2f9e27a8d99d3ed15ddd13bc0fc"} Jun 15 02:28:33.097551 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.097533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nm6r2" event={"ID":"f5c5614d-4794-4df3-af7a-34ebe4400e66","Type":"ContainerStarted","Data":"511ef19c947f7a32d566f464cc4d8d88c8264c6e120550a272e4a2c8d9f13100"} Jun 15 02:28:33.098701 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.098678 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerStarted","Data":"fc6889b731097f149b6a4a138706b08ee1dabae73347af88b0d976629e4f2cef"} Jun 15 02:28:33.643280 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.643235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:33.643464 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.643311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:33.643464 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.643356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:33.643569 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643512 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:28:33.643569 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643529 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:28:33.643569 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643542 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:33.643722 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643601 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:35.643582801 +0000 UTC m=+6.029505401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:33.643722 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643669 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:33.643722 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643703 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:28:35.643692409 +0000 UTC m=+6.029615011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:33.643875 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643755 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:33.643875 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:33.643785 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:35.643774691 +0000 UTC m=+6.029697290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:33.991346 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:33.991265 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 02:28:34.052827 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.052766 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 02:23:32 +0000 UTC" deadline="2028-01-12 19:44:08.705022785 +0000 UTC" Jun 15 02:28:34.052827 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.052827 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13841h15m34.652200218s" Jun 15 02:28:34.082639 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.082609 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:34.082773 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:34.082738 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:34.083166 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.083146 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:34.083271 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:34.083244 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:34.083342 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.083319 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:34.083419 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:34.083402 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:34.127537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.127503 2559 generic.go:356] "Generic (PLEG): container finished" podID="07d71d30e11b1174ec8829e08a2d8881" containerID="d2b2dfd315ddf685bde30ab1fd91d68f7cc804de8582766770011532e710bc71" exitCode=0 Jun 15 02:28:34.128509 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.128472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" event={"ID":"07d71d30e11b1174ec8829e08a2d8881","Type":"ContainerDied","Data":"d2b2dfd315ddf685bde30ab1fd91d68f7cc804de8582766770011532e710bc71"} Jun 15 02:28:34.143214 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:34.143163 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-24.ec2.internal" podStartSLOduration=3.143144502 podStartE2EDuration="3.143144502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:33.105526614 +0000 UTC m=+3.491449222" watchObservedRunningTime="2026-06-15 02:28:34.143144502 +0000 UTC m=+4.529067115" Jun 15 02:28:35.152675 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:35.151958 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" event={"ID":"07d71d30e11b1174ec8829e08a2d8881","Type":"ContainerStarted","Data":"6fb5ce4ecbcb44f1ecc043abe38ad773d0f7eb6c6433dcbcf3827f6590215aea"} Jun 15 02:28:35.658048 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:35.658012 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:35.658227 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:35.658082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:35.658227 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:35.658123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:35.658344 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658281 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:28:35.658344 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658301 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:28:35.658344 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658314 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:35.658499 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658380 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:39.658353405 +0000 UTC m=+10.044275996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:35.658787 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658768 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:35.658853 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658823 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:28:39.658807608 +0000 UTC m=+10.044730210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:35.658920 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658879 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:35.658920 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:35.658911 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:39.658900305 +0000 UTC m=+10.044822898 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:36.080823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:36.080748 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:36.080972 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:36.080876 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:36.080972 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:36.080882 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:36.081104 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:36.081011 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:36.081104 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:36.080760 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:36.081229 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:36.081108 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:38.081390 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:38.081360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:38.081739 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:38.081465 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:38.081778 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:38.081758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:38.081839 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:38.081821 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:38.081891 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:38.081872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:38.081925 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:38.081914 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:39.691357 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:39.691316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:39.691377 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:39.691414 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691501 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691548 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691564 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691573 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691578 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:28:47.691556786 +0000 UTC m=+18.077479379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691612 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:47.691601351 +0000 UTC m=+18.077523938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691654 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:39.691732 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:39.691675 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:28:47.691667937 +0000 UTC m=+18.077590538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:40.084415 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:40.084350 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:40.084768 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:40.084636 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:40.084768 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:40.084666 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:40.084937 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:40.084878 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:40.085277 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:40.085144 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:40.085277 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:40.085228 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:42.080457 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:42.079626 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:42.080457 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:42.079774 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:42.080457 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:42.080159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:42.080457 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:42.080250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:42.080457 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:42.080352 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:42.080457 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:42.080425 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:44.080476 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:44.080439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:44.080863 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:44.080439 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:44.080863 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:44.080566 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:44.080863 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:44.080664 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:44.080863 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:44.080445 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:44.080863 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:44.080758 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:46.080200 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:46.080160 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:46.080638 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:46.080178 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:46.080638 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:46.080293 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:46.080638 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:46.080324 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:46.080638 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:46.080429 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:46.080638 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:46.080491 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:47.754256 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:47.754222 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:47.754274 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:47.754322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754394 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754427 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754450 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754467 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:29:03.754446688 +0000 UTC m=+34.140369299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754469 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754486 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:03.754478355 +0000 UTC m=+34.140400943 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754488 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:47.754684 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:47.754541 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:29:03.75452405 +0000 UTC m=+34.140446663 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:28:48.080073 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:48.079980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:48.080073 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:48.080019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:48.080457 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:48.079980 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:48.080457 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:48.080129 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:48.080457 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:48.080219 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:48.080457 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:48.080313 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:50.080322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:50.080287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:50.080779 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:50.080378 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:50.080779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:50.080402 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:50.080779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:50.080526 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:50.080779 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:50.080587 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:50.080779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:50.080647 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:52.080198 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.080039 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:52.081036 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.080055 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:52.081036 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:52.080275 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:52.081036 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:52.080366 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:52.081036 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.080060 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:52.081036 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:52.080443 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:52.183943 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.183812 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2g55p" event={"ID":"622691a5-4cab-449f-9e46-79aa9c1ce23f","Type":"ContainerStarted","Data":"bee5ef6c9bf60ccc68e33a0ab860384fd36b9b680e04aa14da4882d32fc7238b"} Jun 15 02:28:52.185333 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.185308 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" event={"ID":"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6","Type":"ContainerStarted","Data":"72546295fd0ccb1a3df7c3c8a47e50c7804724374ff5647db4a44f09ce26381a"} Jun 15 02:28:52.186730 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.186694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5wp2f" event={"ID":"e329d7d1-1c4b-42c3-9bd4-04a042d82d13","Type":"ContainerStarted","Data":"1f9b3367981ed60217fc55d1e9d87b8a28386f70b6e9662afe2eecba2d540ac8"} Jun 15 02:28:52.188503 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.188475 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" event={"ID":"d91bf03f-16e1-411c-b9db-8b62eb75e90f","Type":"ContainerStarted","Data":"7dc8dc4ca3bf0501eeb9e8ed44789f114586422dae47b265219b8c59ef79556e"} Jun 15 02:28:52.191746 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.191729 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:28:52.192116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192094 2559 generic.go:356] "Generic (PLEG): container finished" podID="a6281af0-9f59-4120-a4cb-4657c20b7a76" containerID="eab5c6c77f4e0b002cd8538c1863158f99a7be6a27ed1b6fd10436f99275e5f7" exitCode=1 Jun 15 02:28:52.192223 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192205 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"f3617b59f6443a09c572a1e7b1c175e8f705b948c02f493394bbbffa5aff7068"} Jun 15 02:28:52.192577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192281 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"492d89651a9b805ea931597a0025f18a7372dccd003bde50d9ba70854b45886b"} Jun 15 02:28:52.192577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"7df0bfd9303f013bb1cde0089dc64c5bf4ea2cff1f5cc2d3b12e506b838779df"} Jun 15 02:28:52.192577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192371 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"b17dba0a4779ad948c7cbc3933db2dc8251e1b356d774bb8012219f22ebebb4f"} Jun 15 02:28:52.192577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192399 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerDied","Data":"eab5c6c77f4e0b002cd8538c1863158f99a7be6a27ed1b6fd10436f99275e5f7"} Jun 15 02:28:52.192577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.192427 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"b52d62361bad4a5de2210737a402c707ffda5a70ad132d2a2b521e1f77c9962c"} Jun 15 02:28:52.194120 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.194098 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c56b7e5-5839-4895-8676-ed17893e8f47" containerID="6ac7973dbfc89d4846f91920d824c2a9bdb17ba295cc1e20cabfcc17536ad967" exitCode=0 Jun 15 02:28:52.194216 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.194161 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerDied","Data":"6ac7973dbfc89d4846f91920d824c2a9bdb17ba295cc1e20cabfcc17536ad967"} Jun 15 02:28:52.195682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.195650 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-74mjb" event={"ID":"409968b6-a03b-4caf-b7df-e03d50603795","Type":"ContainerStarted","Data":"cfbcee7ae53de41bce2003b7a4f008eca854308252c7309cc7b60a5797535840"} Jun 15 02:28:52.197198 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.197169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j5h7n" event={"ID":"20b9ad28-1085-466e-9216-b558186923c4","Type":"ContainerStarted","Data":"1401e1e62b31d0430e4966ffb4e521ace883a246eb003868e70ae22e398945c7"} Jun 15 02:28:52.198344 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.198247 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-24.ec2.internal" podStartSLOduration=21.198200263 podStartE2EDuration="21.198200263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:35.169406087 +0000 UTC m=+5.555328699" watchObservedRunningTime="2026-06-15 02:28:52.198200263 +0000 UTC m=+22.584122874" Jun 15 02:28:52.199177 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.199136 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2g55p" podStartSLOduration=3.439022547 podStartE2EDuration="22.19911998s" totalImagesPullingTime="18.760097433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:52.198080202 +0000 UTC m=+22.584002824" watchObservedRunningTime="2026-06-15 02:28:52.19911998 +0000 UTC m=+22.585042593" Jun 15 02:28:52.212529 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.212494 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-74mjb" podStartSLOduration=3.459154435 podStartE2EDuration="22.212483302s" totalImagesPullingTime="18.753328867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:52.212470707 +0000 UTC m=+22.598393328" watchObservedRunningTime="2026-06-15 02:28:52.212483302 +0000 UTC m=+22.598405911" Jun 15 02:28:52.235430 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.235392 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5wp2f" podStartSLOduration=3.453128276 podStartE2EDuration="22.235379342s" totalImagesPullingTime="18.782251066s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:52.23511214 +0000 UTC m=+22.621034750" watchObservedRunningTime="2026-06-15 02:28:52.235379342 +0000 UTC m=+22.621301952" Jun 15 02:28:52.249720 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.249674 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j5h7n" podStartSLOduration=8.203298802 podStartE2EDuration="22.249666513s" totalImagesPullingTime="14.046367711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:52.249096615 +0000 UTC m=+22.635019235" watchObservedRunningTime="2026-06-15 02:28:52.249666513 +0000 UTC m=+22.635589122" Jun 15 02:28:52.288242 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.288149 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8jmwp" podStartSLOduration=3.530697803 podStartE2EDuration="22.288138258s" totalImagesPullingTime="18.757440455s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:52.287861596 +0000 UTC m=+22.673784205" watchObservedRunningTime="2026-06-15 02:28:52.288138258 +0000 UTC m=+22.674060868" Jun 15 02:28:52.342058 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.342041 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:52.342505 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.342486 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:52.868041 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.867608 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 02:28:52.934889 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.934818 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:52.935450 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:52.935426 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j5h7n" Jun 15 02:28:53.079651 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:53.079536 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T02:28:52.867793362Z","UUID":"2214904a-758c-4d45-b60e-09dd5dcec928","Handler":null,"Name":"","Endpoint":""} Jun 15 02:28:53.081105 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:53.081082 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 02:28:53.081449 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:53.081120 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 02:28:53.202575 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:53.202486 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" event={"ID":"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6","Type":"ContainerStarted","Data":"8da3348d114ea333c42c173b2a7baa52f2239829449f2d290f8e67c80b4b1990"} Jun 15 02:28:53.204433 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:53.204401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nm6r2" event={"ID":"f5c5614d-4794-4df3-af7a-34ebe4400e66","Type":"ContainerStarted","Data":"197ea41165dc0cfab8f86872fdfde48adb81f3657501eed79c213b26caad83ca"} Jun 15 02:28:54.080076 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:54.080042 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:54.080277 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:54.080077 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:54.080277 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:54.080159 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:54.080277 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:54.080180 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:54.080277 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:54.080260 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:54.080515 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:54.080323 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:54.209305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:54.209227 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" event={"ID":"da4aee62-8ac2-4cbe-ae5b-ffb7e7cca4b6","Type":"ContainerStarted","Data":"9ee14167eaec47c77030ccf45de85372f2f78a77d67f07230dc5693babb1db4e"} Jun 15 02:28:54.227288 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:54.227249 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nm6r2" podStartSLOduration=10.188815686 podStartE2EDuration="24.227230187s" totalImagesPullingTime="14.038414501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:53.220676645 +0000 UTC m=+23.606599256" watchObservedRunningTime="2026-06-15 02:28:54.227230187 +0000 UTC m=+24.613152797" Jun 15 02:28:54.227408 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:54.227384 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9r2zv" podStartSLOduration=3.8905681899999998 podStartE2EDuration="24.227372848s" totalImagesPullingTime="20.336804658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:54.226761192 +0000 UTC m=+24.612683801" watchObservedRunningTime="2026-06-15 02:28:54.227372848 +0000 UTC m=+24.613295462" Jun 15 02:28:55.215159 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:55.215125 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:28:55.215696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:55.215567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"3ef82fa3e1a36f3d531a592b1cb3f3caea6e25fc1547bb90ed1ef2dc726a61b1"} Jun 15 02:28:56.079576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:56.079541 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:56.079744 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:56.079541 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:56.079744 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:56.079659 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:56.079744 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:56.079539 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:56.079744 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:56.079728 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:56.079932 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:56.079850 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:57.223004 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.222812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:28:57.223594 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.223341 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"7e491f662e17c8e0be6c17488163b7998b1f0ca2cca5b7a9d70a2a7af2575a39"} Jun 15 02:28:57.223724 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.223600 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:57.223819 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.223803 2559 scope.go:117] "RemoveContainer" containerID="eab5c6c77f4e0b002cd8538c1863158f99a7be6a27ed1b6fd10436f99275e5f7" Jun 15 02:28:57.225350 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.225325 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c56b7e5-5839-4895-8676-ed17893e8f47" containerID="4962295cf23148c3e7cd55956bf104bea6f215f50a00f18cb3a12fa2e11a8bc0" exitCode=0 Jun 15 02:28:57.225451 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.225371 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerDied","Data":"4962295cf23148c3e7cd55956bf104bea6f215f50a00f18cb3a12fa2e11a8bc0"} Jun 15 02:28:57.242024 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:57.242006 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:58.080569 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.080538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:58.080711 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.080568 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:58.080711 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.080538 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:58.080711 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:58.080649 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:58.080821 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:58.080748 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:58.080821 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:58.080801 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:58.232790 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.232768 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:28:58.233163 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.233141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" event={"ID":"a6281af0-9f59-4120-a4cb-4657c20b7a76","Type":"ContainerStarted","Data":"c7b6b3291e6f2b835b9cd4a3952b7c0843d83d48417df409de82f5a2dd16e4ff"} Jun 15 02:28:58.233468 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.233447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:58.233541 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.233532 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:58.249762 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.249740 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:28:58.260593 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.260555 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" podStartSLOduration=9.450966238 podStartE2EDuration="28.260542004s" totalImagesPullingTime="18.809575766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:28:58.258858878 +0000 UTC m=+28.644781487" watchObservedRunningTime="2026-06-15 02:28:58.260542004 +0000 UTC m=+28.646464614" Jun 15 02:28:58.369042 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.368956 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b7d4h"] Jun 15 02:28:58.369160 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.369087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:28:58.369256 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:58.369191 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:28:58.372574 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.372542 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pkxlc"] Jun 15 02:28:58.372675 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.372613 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:28:58.372741 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:58.372714 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:28:58.373169 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.373146 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nx5lh"] Jun 15 02:28:58.373248 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:58.373228 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:28:58.373360 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:28:58.373339 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:28:59.237268 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:59.237089 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c56b7e5-5839-4895-8676-ed17893e8f47" containerID="bf0ce564a0551b63fb04670364300e561a53cf5019f68d56f9b90dbaeb69d3c6" exitCode=0 Jun 15 02:28:59.237658 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:28:59.237174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerDied","Data":"bf0ce564a0551b63fb04670364300e561a53cf5019f68d56f9b90dbaeb69d3c6"} Jun 15 02:29:00.081080 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:00.081047 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:00.081245 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:00.081118 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:29:00.081245 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:00.081123 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:29:00.081245 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:00.081228 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:29:00.081374 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:00.081287 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:00.081411 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:00.081373 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:29:01.244783 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:01.244749 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c56b7e5-5839-4895-8676-ed17893e8f47" containerID="1a5bdc6af5993be4db0fa3afbe702a796aef30df4c71fe6baf995ea6fcd46edc" exitCode=0 Jun 15 02:29:01.245452 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:01.244795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerDied","Data":"1a5bdc6af5993be4db0fa3afbe702a796aef30df4c71fe6baf995ea6fcd46edc"} Jun 15 02:29:02.080503 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:02.080465 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:02.080668 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:02.080567 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:29:02.080668 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:02.080465 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:29:02.080668 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:02.080614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:02.080771 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:02.080731 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:29:02.080834 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:02.080816 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:29:03.766135 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:03.766094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:03.766169 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:03.766208 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766289 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766315 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766315 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766315 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766329 2559 projected.go:196] Error preparing data for projected volume kube-api-access-hbtvn for pod openshift-network-diagnostics/network-check-target-b7d4h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766389 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn podName:47d336a4-de56-4ac4-bfd4-2d7c02ff615a nodeName:}" failed. No retries permitted until 2026-06-15 02:29:35.766369461 +0000 UTC m=+66.152292067 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hbtvn" (UniqueName: "kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn") pod "network-check-target-b7d4h" (UID: "47d336a4-de56-4ac4-bfd4-2d7c02ff615a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766412 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:29:35.766401018 +0000 UTC m=+66.152323612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 02:29:03.766633 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:03.766426 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret podName:271f66fd-aa03-478a-b5f4-389e9b318d91 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:35.766419258 +0000 UTC m=+66.152341846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret") pod "global-pull-secret-syncer-pkxlc" (UID: "271f66fd-aa03-478a-b5f4-389e9b318d91") : object "kube-system"/"original-pull-secret" not registered Jun 15 02:29:04.080176 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.079929 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:04.080317 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.080216 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pkxlc" podUID="271f66fd-aa03-478a-b5f4-389e9b318d91" Jun 15 02:29:04.080317 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.080020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:04.080317 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.080308 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-b7d4h" podUID="47d336a4-de56-4ac4-bfd4-2d7c02ff615a" Jun 15 02:29:04.080441 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.079931 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:29:04.080441 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.080384 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:29:04.481071 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.481046 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-24.ec2.internal" event="NodeReady" Jun 15 02:29:04.481275 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.481159 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 02:29:04.522807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.522780 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5dc4bf4b5-t8kwx"] Jun 15 02:29:04.547836 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.546197 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bh7cd"] Jun 15 02:29:04.547836 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.546678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.550696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.550673 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 15 02:29:04.550869 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.550830 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 15 02:29:04.551044 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.550875 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 15 02:29:04.551168 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.550920 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8fqxc\"" Jun 15 02:29:04.557836 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.557812 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 15 02:29:04.562029 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.562010 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dz8b9"] Jun 15 02:29:04.562141 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.562085 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.564616 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.564598 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 02:29:04.565363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.564960 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vrtgk\"" Jun 15 02:29:04.565363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.565171 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 02:29:04.584128 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.584103 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc4bf4b5-t8kwx"] Jun 15 02:29:04.584244 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.584134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bh7cd"] Jun 15 02:29:04.584244 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.584161 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dz8b9"] Jun 15 02:29:04.584244 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.584213 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.587169 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.587145 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 02:29:04.587322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.587200 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 02:29:04.587322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.587217 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 02:29:04.587322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.587274 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fllmd\"" Jun 15 02:29:04.672679 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672644 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-image-registry-private-configuration\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.672842 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672683 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/707efa2d-6065-4258-98f2-1807dd389882-tmp-dir\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.672842 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.672842 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672738 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/707efa2d-6065-4258-98f2-1807dd389882-config-volume\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.672983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672857 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-trusted-ca\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.672983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk242\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-kube-api-access-zk242\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.672983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672920 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.672983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tjk\" (UniqueName: \"kubernetes.io/projected/707efa2d-6065-4258-98f2-1807dd389882-kube-api-access-v6tjk\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.672983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672965 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-installation-pull-secrets\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.672983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.672982 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-bound-sa-token\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.673298 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.673022 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc301e02-5d66-4ee7-8e02-9a3732ac2bab-cert\") pod \"ingress-canary-dz8b9\" (UID: \"cc301e02-5d66-4ee7-8e02-9a3732ac2bab\") " pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.673298 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.673077 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-certificates\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.673298 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.673126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-ca-trust-extracted\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.673298 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.673150 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwrk5\" (UniqueName: \"kubernetes.io/projected/cc301e02-5d66-4ee7-8e02-9a3732ac2bab-kube-api-access-rwrk5\") pod \"ingress-canary-dz8b9\" (UID: \"cc301e02-5d66-4ee7-8e02-9a3732ac2bab\") " pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.774520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-image-registry-private-configuration\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.774520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/707efa2d-6065-4258-98f2-1807dd389882-tmp-dir\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.774520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774514 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/707efa2d-6065-4258-98f2-1807dd389882-config-volume\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-trusted-ca\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.774645 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.774667 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.774742 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:29:05.274721091 +0000 UTC m=+35.660643695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk242\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-kube-api-access-zk242\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774909 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774934 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tjk\" (UniqueName: \"kubernetes.io/projected/707efa2d-6065-4258-98f2-1807dd389882-kube-api-access-v6tjk\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774959 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-installation-pull-secrets\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774982 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-bound-sa-token\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775027 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc301e02-5d66-4ee7-8e02-9a3732ac2bab-cert\") pod \"ingress-canary-dz8b9\" (UID: \"cc301e02-5d66-4ee7-8e02-9a3732ac2bab\") " pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-certificates\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775132 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-ca-trust-extracted\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775740 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwrk5\" (UniqueName: \"kubernetes.io/projected/cc301e02-5d66-4ee7-8e02-9a3732ac2bab-kube-api-access-rwrk5\") pod \"ingress-canary-dz8b9\" (UID: \"cc301e02-5d66-4ee7-8e02-9a3732ac2bab\") " pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.775740 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/707efa2d-6065-4258-98f2-1807dd389882-config-volume\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.775740 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.774869 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/707efa2d-6065-4258-98f2-1807dd389882-tmp-dir\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.775740 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.775705 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:04.775934 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:04.775781 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:05.275762924 +0000 UTC m=+35.661685530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:04.775934 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775878 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-certificates\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.775934 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.775896 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-trusted-ca\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.776132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.776108 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-ca-trust-extracted\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.779620 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.779594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-image-registry-private-configuration\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.779709 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.779601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-installation-pull-secrets\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.784343 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.784302 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk242\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-kube-api-access-zk242\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.784439 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.784398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tjk\" (UniqueName: \"kubernetes.io/projected/707efa2d-6065-4258-98f2-1807dd389882-kube-api-access-v6tjk\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:04.784570 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.784550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-bound-sa-token\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:04.788187 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.788150 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc301e02-5d66-4ee7-8e02-9a3732ac2bab-cert\") pod \"ingress-canary-dz8b9\" (UID: \"cc301e02-5d66-4ee7-8e02-9a3732ac2bab\") " pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.788568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.788548 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwrk5\" (UniqueName: \"kubernetes.io/projected/cc301e02-5d66-4ee7-8e02-9a3732ac2bab-kube-api-access-rwrk5\") pod \"ingress-canary-dz8b9\" (UID: \"cc301e02-5d66-4ee7-8e02-9a3732ac2bab\") " pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.890853 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.890813 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:04.894777 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.894753 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dz8b9" Jun 15 02:29:04.973719 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:04.973689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:05.067583 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:05.067476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:05.280075 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:05.280037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:05.280269 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:05.280095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:05.280269 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:05.280202 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:05.280269 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:05.280222 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:05.280269 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:05.280220 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:05.280480 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:05.280280 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:29:06.280261381 +0000 UTC m=+36.666183970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:05.280480 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:05.280296 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:06.280289435 +0000 UTC m=+36.666212023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:05.749896 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:05.749867 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dz8b9"] Jun 15 02:29:05.830217 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:29:05.830179 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc301e02_5d66_4ee7_8e02_9a3732ac2bab.slice/crio-874c4b920f7b1ada6ec7f0c4fd260bb2e742349f2a2056300b764ddb590cbf61 WatchSource:0}: Error finding container 874c4b920f7b1ada6ec7f0c4fd260bb2e742349f2a2056300b764ddb590cbf61: Status 404 returned error can't find the container with id 874c4b920f7b1ada6ec7f0c4fd260bb2e742349f2a2056300b764ddb590cbf61 Jun 15 02:29:06.080117 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.079863 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:29:06.080223 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.079880 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:06.080284 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.079904 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:06.083340 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.083317 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 02:29:06.083488 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.083473 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 02:29:06.087802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.084861 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 02:29:06.087802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.084890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 02:29:06.087802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.084935 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cch6q\"" Jun 15 02:29:06.087802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.084869 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j9gzq\"" Jun 15 02:29:06.258235 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.258210 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dz8b9" event={"ID":"cc301e02-5d66-4ee7-8e02-9a3732ac2bab","Type":"ContainerStarted","Data":"874c4b920f7b1ada6ec7f0c4fd260bb2e742349f2a2056300b764ddb590cbf61"} Jun 15 02:29:06.260644 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.260622 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c56b7e5-5839-4895-8676-ed17893e8f47" containerID="fba939071e0e1b1553421538040bf5c7b6b761b2425cd594a6460dfa59339a3f" exitCode=0 Jun 15 02:29:06.260723 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.260658 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerDied","Data":"fba939071e0e1b1553421538040bf5c7b6b761b2425cd594a6460dfa59339a3f"} Jun 15 02:29:06.288431 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.288405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:06.288517 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:06.288441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:06.288564 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:06.288539 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:06.288564 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:06.288541 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:06.288564 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:06.288555 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:06.288671 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:06.288602 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:29:08.288588151 +0000 UTC m=+38.674510741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:06.288671 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:06.288615 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:08.288608935 +0000 UTC m=+38.674531529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:07.267131 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:07.267079 2559 generic.go:356] "Generic (PLEG): container finished" podID="5c56b7e5-5839-4895-8676-ed17893e8f47" containerID="8e887e62692affec0d303182073a939726571f3ae3a188353496f2aa2f4bb1b4" exitCode=0 Jun 15 02:29:07.267131 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:07.267126 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerDied","Data":"8e887e62692affec0d303182073a939726571f3ae3a188353496f2aa2f4bb1b4"} Jun 15 02:29:08.270499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.270408 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dz8b9" event={"ID":"cc301e02-5d66-4ee7-8e02-9a3732ac2bab","Type":"ContainerStarted","Data":"a9a2c324c8c4f7c4b876eeaa788c6bb6363e9f4050845de25cca39658c253bfc"} Jun 15 02:29:08.273501 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.273473 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" event={"ID":"5c56b7e5-5839-4895-8676-ed17893e8f47","Type":"ContainerStarted","Data":"e06574bf447c55d9708f9f8d01a8e94a6e37ba4dc0f2074683657ecc31e62069"} Jun 15 02:29:08.285407 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.285365 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dz8b9" podStartSLOduration=2.443502264 podStartE2EDuration="4.285352253s" totalImagesPullingTime="1.841849989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:29:08.285116143 +0000 UTC m=+38.671038788" watchObservedRunningTime="2026-06-15 02:29:08.285352253 +0000 UTC m=+38.671274863" Jun 15 02:29:08.306451 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.306397 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wg2lk" podStartSLOduration=8.919552653 podStartE2EDuration="38.306381384s" totalImagesPullingTime="29.386828731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:29:08.304366812 +0000 UTC m=+38.690289422" watchObservedRunningTime="2026-06-15 02:29:08.306381384 +0000 UTC m=+38.692304012" Jun 15 02:29:08.306949 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.306925 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:08.307026 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.306979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:08.307093 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:08.307077 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:08.307129 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:08.307095 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:08.307129 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:08.307098 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:08.307194 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:08.307145 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:29:12.307128811 +0000 UTC m=+42.693051402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:08.307194 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:08.307158 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:12.307152429 +0000 UTC m=+42.693075017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:08.426124 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.426074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:08.478110 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:08.478065 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:09.037977 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:09.037951 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:09.136658 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:09.136610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:12.335637 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:12.335600 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:12.335637 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:12.335645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:12.336081 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:12.335739 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:12.336081 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:12.335755 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:12.336081 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:12.335775 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:12.336081 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:12.335790 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:20.335776831 +0000 UTC m=+50.721699432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:12.336081 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:12.335821 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:29:20.335808599 +0000 UTC m=+50.721731186 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:14.908938 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:14.908906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:15.748439 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:15.748407 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:15.848822 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:15.848769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:20.391366 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:20.391324 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:20.391366 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:20.391368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:20.391946 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:20.391454 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:20.391946 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:20.391462 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:20.391946 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:20.391485 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:20.391946 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:20.391511 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:29:36.391499155 +0000 UTC m=+66.777421758 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:20.391946 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:20.391543 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:29:36.391530204 +0000 UTC m=+66.777452796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:26.473904 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:26.473865 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:26.567121 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:26.567086 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:26.666863 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:26.666834 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:27.504313 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:27.504277 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:27.604257 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:27.604225 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:30.257501 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:30.257466 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h6h8k" Jun 15 02:29:30.406238 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:30.406205 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:30.456965 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:30.456938 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:30.869746 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:30.869717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:30.970207 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:30.970176 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:34.643127 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:34.643081 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:35.800014 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.799944 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:35.800014 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.800021 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:29:35.800435 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.800050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:35.802696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.802672 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 02:29:35.802696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.802691 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 02:29:35.802791 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.802746 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 02:29:35.811050 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:35.811029 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 02:29:35.811114 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:35.811102 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:30:39.811081096 +0000 UTC m=+130.197003683 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : secret "metrics-daemon-secret" not found Jun 15 02:29:35.813311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.813297 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 02:29:35.814340 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.814324 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/271f66fd-aa03-478a-b5f4-389e9b318d91-original-pull-secret\") pod \"global-pull-secret-syncer-pkxlc\" (UID: \"271f66fd-aa03-478a-b5f4-389e9b318d91\") " pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:35.823681 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.823662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtvn\" (UniqueName: \"kubernetes.io/projected/47d336a4-de56-4ac4-bfd4-2d7c02ff615a-kube-api-access-hbtvn\") pod \"network-check-target-b7d4h\" (UID: \"47d336a4-de56-4ac4-bfd4-2d7c02ff615a\") " pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:35.850787 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.850758 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pkxlc" Jun 15 02:29:35.857922 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.857896 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cch6q\"" Jun 15 02:29:35.866126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.866107 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:35.995928 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:35.995723 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pkxlc"] Jun 15 02:29:35.998329 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:29:35.998291 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod271f66fd_aa03_478a_b5f4_389e9b318d91.slice/crio-d076265d703a88e3b63e08645b3694b934d29b645c363cac0fda0921fc3625ae WatchSource:0}: Error finding container d076265d703a88e3b63e08645b3694b934d29b645c363cac0fda0921fc3625ae: Status 404 returned error can't find the container with id d076265d703a88e3b63e08645b3694b934d29b645c363cac0fda0921fc3625ae Jun 15 02:29:36.030672 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:36.030644 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-b7d4h"] Jun 15 02:29:36.033403 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:29:36.033376 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d336a4_de56_4ac4_bfd4_2d7c02ff615a.slice/crio-609c83f05b4d51312db70e27e9a08a83746179c42f1e764426ed147c924ae223 WatchSource:0}: Error finding container 609c83f05b4d51312db70e27e9a08a83746179c42f1e764426ed147c924ae223: Status 404 returned error can't find the container with id 609c83f05b4d51312db70e27e9a08a83746179c42f1e764426ed147c924ae223 Jun 15 02:29:36.340801 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:36.340757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b7d4h" event={"ID":"47d336a4-de56-4ac4-bfd4-2d7c02ff615a","Type":"ContainerStarted","Data":"609c83f05b4d51312db70e27e9a08a83746179c42f1e764426ed147c924ae223"} Jun 15 02:29:36.341884 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:36.341842 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pkxlc" event={"ID":"271f66fd-aa03-478a-b5f4-389e9b318d91","Type":"ContainerStarted","Data":"d076265d703a88e3b63e08645b3694b934d29b645c363cac0fda0921fc3625ae"} Jun 15 02:29:36.404820 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:36.404778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:29:36.405026 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:36.404845 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:29:36.405026 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:36.404966 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:29:36.405026 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:36.404976 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:29:36.405026 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:36.405008 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:29:36.405283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:36.405065 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:30:08.405044489 +0000 UTC m=+98.790967095 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:29:36.405283 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:29:36.405083 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:30:08.405073803 +0000 UTC m=+98.790996407 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:29:37.170956 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:37.170867 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:37.272516 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:37.272454 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:40.355466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:40.355430 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-b7d4h" event={"ID":"47d336a4-de56-4ac4-bfd4-2d7c02ff615a","Type":"ContainerStarted","Data":"02d7182d43711e84c9319e127c5b6404a24a0491802ae36dd440693e2f1d9ea9"} Jun 15 02:29:40.355901 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:40.355558 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:29:40.357011 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:40.356972 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pkxlc" event={"ID":"271f66fd-aa03-478a-b5f4-389e9b318d91","Type":"ContainerStarted","Data":"30b5eee1c371552f41abbf9f616271e5efc29580be9158e3986e338c0e28fc0f"} Jun 15 02:29:40.371649 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:40.371598 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-b7d4h" podStartSLOduration=66.187097253 podStartE2EDuration="1m10.371585199s" totalImagesPullingTime="4.184487946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:29:40.370137874 +0000 UTC m=+70.756060497" watchObservedRunningTime="2026-06-15 02:29:40.371585199 +0000 UTC m=+70.757507809" Jun 15 02:29:40.383515 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:40.383454 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pkxlc" podStartSLOduration=66.159610215 podStartE2EDuration="1m10.383434871s" totalImagesPullingTime="4.223824656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:29:40.383343967 +0000 UTC m=+70.769266577" watchObservedRunningTime="2026-06-15 02:29:40.383434871 +0000 UTC m=+70.769357482" Jun 15 02:29:43.419233 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:43.419196 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:43.473529 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:43.473500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:43.620622 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:43.620592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:29:43.670924 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:29:43.670855 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:30:03.541754 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:03.541714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:30:03.608855 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:03.608818 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:30:03.669198 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:03.669167 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:30:08.430103 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:08.430071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:30:08.430470 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:08.430109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:30:08.430470 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:08.430210 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:30:08.430470 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:08.430216 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:30:08.430470 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:08.430234 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:30:08.430470 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:08.430270 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:31:12.430255672 +0000 UTC m=+162.816178273 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:30:08.430470 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:08.430290 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:31:12.430275584 +0000 UTC m=+162.816198176 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:30:11.361470 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:11.361435 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-b7d4h" Jun 15 02:30:39.836527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:30:39.836488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:30:39.837018 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:39.836605 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 15 02:30:39.837018 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:30:39.836666 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs podName:8852e474-0727-45d4-93c0-67ea29e0fe6a nodeName:}" failed. No retries permitted until 2026-06-15 02:32:41.836652228 +0000 UTC m=+252.222574817 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs") pod "network-metrics-daemon-nx5lh" (UID: "8852e474-0727-45d4-93c0-67ea29e0fe6a") : secret "metrics-daemon-secret" not found Jun 15 02:31:07.560355 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:07.560316 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" Jun 15 02:31:07.571400 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:07.571361 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bh7cd" podUID="707efa2d-6065-4258-98f2-1807dd389882" Jun 15 02:31:08.558288 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:31:08.558265 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bh7cd" Jun 15 02:31:08.558440 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:31:08.558268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:31:09.144946 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:09.144906 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nx5lh" podUID="8852e474-0727-45d4-93c0-67ea29e0fe6a" Jun 15 02:31:12.461887 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:31:12.461836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:31:12.461887 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:31:12.461892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:31:12.462441 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:12.462011 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 15 02:31:12.462441 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:12.462021 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 15 02:31:12.462441 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:12.462040 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5dc4bf4b5-t8kwx: secret "image-registry-tls" not found Jun 15 02:31:12.462441 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:12.462075 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls podName:707efa2d-6065-4258-98f2-1807dd389882 nodeName:}" failed. No retries permitted until 2026-06-15 02:33:14.46206155 +0000 UTC m=+284.847984138 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls") pod "dns-default-bh7cd" (UID: "707efa2d-6065-4258-98f2-1807dd389882") : secret "dns-default-metrics-tls" not found Jun 15 02:31:12.462441 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:31:12.462096 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls podName:ded3fd27-5ff8-4b78-881f-731c0d3e10dd nodeName:}" failed. No retries permitted until 2026-06-15 02:33:14.4620815 +0000 UTC m=+284.848004088 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls") pod "image-registry-5dc4bf4b5-t8kwx" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd") : secret "image-registry-tls" not found Jun 15 02:31:22.079848 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:31:22.079771 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:32:16.698732 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:16.698698 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:17.501038 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.500984 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl"] Jun 15 02:32:17.502877 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.502861 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.505090 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.505064 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj"] Jun 15 02:32:17.505741 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.505715 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.505860 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.505784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 15 02:32:17.506075 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.506053 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.506214 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.506197 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 15 02:32:17.506342 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.506326 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-m9nnd\"" Jun 15 02:32:17.507029 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.507015 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-766cn"] Jun 15 02:32:17.507100 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.507086 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.508751 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.508734 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:17.509592 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.509572 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-5tmvs\"" Jun 15 02:32:17.509674 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.509594 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 15 02:32:17.509944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.509928 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 15 02:32:17.510170 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.510153 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.510222 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.510204 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.512131 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.512116 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 15 02:32:17.512869 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.512857 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-trd6z\"" Jun 15 02:32:17.512912 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.512865 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 15 02:32:17.514447 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.514426 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl"] Jun 15 02:32:17.522467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.522446 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj"] Jun 15 02:32:17.523087 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.523071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-766cn"] Jun 15 02:32:17.599981 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.599948 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj"] Jun 15 02:32:17.601672 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.601656 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" Jun 15 02:32:17.604293 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.604274 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc"] Jun 15 02:32:17.604666 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.604648 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.604756 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.604648 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5dvds\"" Jun 15 02:32:17.604756 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.604686 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.606421 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606237 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3faa307-10ac-46cd-926e-213c889b97fe-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.606421 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606272 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/1d49b714-3287-43aa-b880-61b5bea8deeb-kube-api-access-5jmmc\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.606421 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e600738-ee08-48fe-aba2-14a2b8540111-nginx-conf\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:17.606421 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:17.606806 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3faa307-10ac-46cd-926e-213c889b97fe-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.606806 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pccm2\" (UniqueName: \"kubernetes.io/projected/a3faa307-10ac-46cd-926e-213c889b97fe-kube-api-access-pccm2\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.606806 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606502 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d49b714-3287-43aa-b880-61b5bea8deeb-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.606806 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606528 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d49b714-3287-43aa-b880-61b5bea8deeb-config\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.606806 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606804 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct"] Jun 15 02:32:17.607089 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.606918 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.608475 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.608457 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-tlmrs"] Jun 15 02:32:17.608581 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.608564 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:17.610235 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.610215 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 15 02:32:17.610353 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.610339 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.610424 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.610346 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d87xn\"" Jun 15 02:32:17.610458 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.610448 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.610622 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.610606 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-65dd75fbbd-wbt2h"] Jun 15 02:32:17.610710 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.610698 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.612309 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.612292 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.613197 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613177 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.613297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613228 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.613297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613207 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 15 02:32:17.613297 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613230 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8hnbf\"" Jun 15 02:32:17.613458 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613205 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 15 02:32:17.613458 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613434 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.613557 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613481 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 15 02:32:17.613685 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.613670 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.614211 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.614192 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-dzq7w\"" Jun 15 02:32:17.614294 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.614196 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 15 02:32:17.614963 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.614945 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 15 02:32:17.615342 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.615324 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj"] Jun 15 02:32:17.615406 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.615387 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 15 02:32:17.615459 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.615401 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 02:32:17.615706 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.615689 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 15 02:32:17.616180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.616064 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 15 02:32:17.616180 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.616123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 02:32:17.616511 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.616487 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4852h\"" Jun 15 02:32:17.621535 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.621516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 15 02:32:17.621773 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.621759 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct"] Jun 15 02:32:17.622741 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.622722 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-tlmrs"] Jun 15 02:32:17.623770 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.623750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc"] Jun 15 02:32:17.624929 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.624911 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65dd75fbbd-wbt2h"] Jun 15 02:32:17.694103 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.694068 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv"] Jun 15 02:32:17.696066 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.696032 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" Jun 15 02:32:17.701288 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.701267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-gdj8l\"" Jun 15 02:32:17.707110 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.707217 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.707217 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d49b714-3287-43aa-b880-61b5bea8deeb-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.707331 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/1d49b714-3287-43aa-b880-61b5bea8deeb-kube-api-access-5jmmc\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.707331 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7flk6\" (UniqueName: \"kubernetes.io/projected/a0b84785-254c-4a0c-8e5e-cad8056d6e72-kube-api-access-7flk6\") pod \"volume-data-source-validator-bd4ccd799-p8vsj\" (UID: \"a0b84785-254c-4a0c-8e5e-cad8056d6e72\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" Jun 15 02:32:17.707331 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71163f29-58d5-4390-be0d-75104fdd2d79-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.707331 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d49b714-3287-43aa-b880-61b5bea8deeb-config\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.707542 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3faa307-10ac-46cd-926e-213c889b97fe-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.707542 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707361 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lt46\" (UniqueName: \"kubernetes.io/projected/9631d33a-8f79-4f1e-b1f2-80a9137ab308-kube-api-access-2lt46\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.707542 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707482 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:17.707542 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707529 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e600738-ee08-48fe-aba2-14a2b8540111-nginx-conf\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:17.707742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707556 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:17.707742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71163f29-58d5-4390-be0d-75104fdd2d79-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.707742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pccm2\" (UniqueName: \"kubernetes.io/projected/a3faa307-10ac-46cd-926e-213c889b97fe-kube-api-access-pccm2\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.707742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707654 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.707742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71163f29-58d5-4390-be0d-75104fdd2d79-tmp\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.707742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3faa307-10ac-46cd-926e-213c889b97fe-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707741 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx2p7\" (UniqueName: \"kubernetes.io/projected/71163f29-58d5-4390-be0d-75104fdd2d79-kube-api-access-nx2p7\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707770 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9854\" (UniqueName: \"kubernetes.io/projected/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-kube-api-access-r9854\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71163f29-58d5-4390-be0d-75104fdd2d79-snapshots\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707819 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-default-certificate\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707852 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71163f29-58d5-4390-be0d-75104fdd2d79-serving-cert\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjmz2\" (UniqueName: \"kubernetes.io/projected/904d3d6f-17b0-48d1-870b-835299a7b072-kube-api-access-rjmz2\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707922 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-stats-auth\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.708054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.707946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/904d3d6f-17b0-48d1-870b-835299a7b072-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.708520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.708270 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d49b714-3287-43aa-b880-61b5bea8deeb-config\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.708520 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.708349 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 02:32:17.708520 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.708416 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert podName:5e600738-ee08-48fe-aba2-14a2b8540111 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:18.208394314 +0000 UTC m=+228.594316915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-766cn" (UID: "5e600738-ee08-48fe-aba2-14a2b8540111") : secret "networking-console-plugin-cert" not found Jun 15 02:32:17.708705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.708541 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv"] Jun 15 02:32:17.708705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.708663 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5e600738-ee08-48fe-aba2-14a2b8540111-nginx-conf\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:17.709133 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.709106 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3faa307-10ac-46cd-926e-213c889b97fe-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.709769 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.709740 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d49b714-3287-43aa-b880-61b5bea8deeb-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.709843 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.709830 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3faa307-10ac-46cd-926e-213c889b97fe-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.717655 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.717636 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jmmc\" (UniqueName: \"kubernetes.io/projected/1d49b714-3287-43aa-b880-61b5bea8deeb-kube-api-access-5jmmc\") pod \"service-ca-operator-7ccbfd59dc-9nkfl\" (UID: \"1d49b714-3287-43aa-b880-61b5bea8deeb\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.719885 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.719863 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccm2\" (UniqueName: \"kubernetes.io/projected/a3faa307-10ac-46cd-926e-213c889b97fe-kube-api-access-pccm2\") pod \"kube-storage-version-migrator-operator-7c578b78fc-xkcbj\" (UID: \"a3faa307-10ac-46cd-926e-213c889b97fe\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.769004 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.768918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:17.809050 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71163f29-58d5-4390-be0d-75104fdd2d79-tmp\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809062 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx2p7\" (UniqueName: \"kubernetes.io/projected/71163f29-58d5-4390-be0d-75104fdd2d79-kube-api-access-nx2p7\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809090 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9854\" (UniqueName: \"kubernetes.io/projected/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-kube-api-access-r9854\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:17.809172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809115 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71163f29-58d5-4390-be0d-75104fdd2d79-snapshots\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-default-certificate\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.809172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71163f29-58d5-4390-be0d-75104fdd2d79-serving-cert\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809416 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjmz2\" (UniqueName: \"kubernetes.io/projected/904d3d6f-17b0-48d1-870b-835299a7b072-kube-api-access-rjmz2\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.809416 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809234 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-stats-auth\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.809416 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809259 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/904d3d6f-17b0-48d1-870b-835299a7b072-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.809416 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809294 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.809416 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.809416 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7flk6\" (UniqueName: \"kubernetes.io/projected/a0b84785-254c-4a0c-8e5e-cad8056d6e72-kube-api-access-7flk6\") pod \"volume-data-source-validator-bd4ccd799-p8vsj\" (UID: \"a0b84785-254c-4a0c-8e5e-cad8056d6e72\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" Jun 15 02:32:17.809693 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71163f29-58d5-4390-be0d-75104fdd2d79-tmp\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809693 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.809595 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:18.309570169 +0000 UTC m=+228.695492757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : configmap references non-existent config key: service-ca.crt Jun 15 02:32:17.809693 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.809666 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 02:32:17.809858 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.809716 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:18.309699195 +0000 UTC m=+228.695621783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : secret "router-metrics-certs-default" not found Jun 15 02:32:17.809858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809738 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/71163f29-58d5-4390-be0d-75104fdd2d79-snapshots\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71163f29-58d5-4390-be0d-75104fdd2d79-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.809858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809801 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsbz4\" (UniqueName: \"kubernetes.io/projected/e0d15bef-2db6-484f-a7cb-971b06aff1d8-kube-api-access-lsbz4\") pod \"network-check-source-6947749cfc-s7hkv\" (UID: \"e0d15bef-2db6-484f-a7cb-971b06aff1d8\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" Jun 15 02:32:17.809858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.809838 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lt46\" (UniqueName: \"kubernetes.io/projected/9631d33a-8f79-4f1e-b1f2-80a9137ab308-kube-api-access-2lt46\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.810164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.810087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:17.810164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.810142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71163f29-58d5-4390-be0d-75104fdd2d79-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.810274 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.810189 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.810332 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.810278 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/904d3d6f-17b0-48d1-870b-835299a7b072-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.810332 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.810288 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 02:32:17.810332 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.810288 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:17.810481 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.810349 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls podName:904d3d6f-17b0-48d1-870b-835299a7b072 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:18.31033366 +0000 UTC m=+228.696256274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-pwnjc" (UID: "904d3d6f-17b0-48d1-870b-835299a7b072") : secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:17.810481 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:17.810368 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls podName:bc3b2ba8-3fec-4eee-8108-331f94bc7b03 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:18.310359371 +0000 UTC m=+228.696281960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rh2ct" (UID: "bc3b2ba8-3fec-4eee-8108-331f94bc7b03") : secret "samples-operator-tls" not found Jun 15 02:32:17.810591 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.810569 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71163f29-58d5-4390-be0d-75104fdd2d79-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.810733 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.810711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71163f29-58d5-4390-be0d-75104fdd2d79-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.811904 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.811882 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71163f29-58d5-4390-be0d-75104fdd2d79-serving-cert\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.812022 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.811973 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-default-certificate\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.812022 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.811981 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-stats-auth\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.813812 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.813798 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" Jun 15 02:32:17.821140 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.820843 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" Jun 15 02:32:17.821140 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.821096 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjmz2\" (UniqueName: \"kubernetes.io/projected/904d3d6f-17b0-48d1-870b-835299a7b072-kube-api-access-rjmz2\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:17.821389 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.821364 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lt46\" (UniqueName: \"kubernetes.io/projected/9631d33a-8f79-4f1e-b1f2-80a9137ab308-kube-api-access-2lt46\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:17.821533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.821517 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx2p7\" (UniqueName: \"kubernetes.io/projected/71163f29-58d5-4390-be0d-75104fdd2d79-kube-api-access-nx2p7\") pod \"insights-operator-5bbd86d6bd-tlmrs\" (UID: \"71163f29-58d5-4390-be0d-75104fdd2d79\") " pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.821568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.821530 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9854\" (UniqueName: \"kubernetes.io/projected/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-kube-api-access-r9854\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:17.821942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.821915 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7flk6\" (UniqueName: \"kubernetes.io/projected/a0b84785-254c-4a0c-8e5e-cad8056d6e72-kube-api-access-7flk6\") pod \"volume-data-source-validator-bd4ccd799-p8vsj\" (UID: \"a0b84785-254c-4a0c-8e5e-cad8056d6e72\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" Jun 15 02:32:17.868758 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.868694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:17.911581 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.911551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsbz4\" (UniqueName: \"kubernetes.io/projected/e0d15bef-2db6-484f-a7cb-971b06aff1d8-kube-api-access-lsbz4\") pod \"network-check-source-6947749cfc-s7hkv\" (UID: \"e0d15bef-2db6-484f-a7cb-971b06aff1d8\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" Jun 15 02:32:17.913398 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.913382 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" Jun 15 02:32:17.920766 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.920713 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsbz4\" (UniqueName: \"kubernetes.io/projected/e0d15bef-2db6-484f-a7cb-971b06aff1d8-kube-api-access-lsbz4\") pod \"network-check-source-6947749cfc-s7hkv\" (UID: \"e0d15bef-2db6-484f-a7cb-971b06aff1d8\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" Jun 15 02:32:17.936106 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.936081 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" Jun 15 02:32:17.947935 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.947810 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl"] Jun 15 02:32:17.950396 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:17.950371 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d49b714_3287_43aa_b880_61b5bea8deeb.slice/crio-bd349f20c74fbd307a25c729a85b58fee4c7689fd428d4d8f9de5469eefb85c8 WatchSource:0}: Error finding container bd349f20c74fbd307a25c729a85b58fee4c7689fd428d4d8f9de5469eefb85c8: Status 404 returned error can't find the container with id bd349f20c74fbd307a25c729a85b58fee4c7689fd428d4d8f9de5469eefb85c8 Jun 15 02:32:17.961960 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:17.961879 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj"] Jun 15 02:32:17.964008 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:17.963965 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3faa307_10ac_46cd_926e_213c889b97fe.slice/crio-f853819f1eda88dc87796d1cc30db1946056f9d7bacbea8cf6f0a15c72c3ae9d WatchSource:0}: Error finding container f853819f1eda88dc87796d1cc30db1946056f9d7bacbea8cf6f0a15c72c3ae9d: Status 404 returned error can't find the container with id f853819f1eda88dc87796d1cc30db1946056f9d7bacbea8cf6f0a15c72c3ae9d Jun 15 02:32:18.004171 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.004143 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" Jun 15 02:32:18.060099 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.060058 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj"] Jun 15 02:32:18.064305 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:18.064284 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b84785_254c_4a0c_8e5e_cad8056d6e72.slice/crio-2bbbca612a09dc98f684431ff25108ffba7d8125e2c7b13f123c5dd0b36d2495 WatchSource:0}: Error finding container 2bbbca612a09dc98f684431ff25108ffba7d8125e2c7b13f123c5dd0b36d2495: Status 404 returned error can't find the container with id 2bbbca612a09dc98f684431ff25108ffba7d8125e2c7b13f123c5dd0b36d2495 Jun 15 02:32:18.084059 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.084034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-tlmrs"] Jun 15 02:32:18.087339 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:18.087313 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71163f29_58d5_4390_be0d_75104fdd2d79.slice/crio-5c360e24207b5a14180abaa7a3c9e491f7705391dfac20aff814d8a639a7953c WatchSource:0}: Error finding container 5c360e24207b5a14180abaa7a3c9e491f7705391dfac20aff814d8a639a7953c: Status 404 returned error can't find the container with id 5c360e24207b5a14180abaa7a3c9e491f7705391dfac20aff814d8a639a7953c Jun 15 02:32:18.134442 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.134411 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv"] Jun 15 02:32:18.136794 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:18.136774 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d15bef_2db6_484f_a7cb_971b06aff1d8.slice/crio-840602e2814c109ad978565490d187952253a1372427af687a3d6617462f9e64 WatchSource:0}: Error finding container 840602e2814c109ad978565490d187952253a1372427af687a3d6617462f9e64: Status 404 returned error can't find the container with id 840602e2814c109ad978565490d187952253a1372427af687a3d6617462f9e64 Jun 15 02:32:18.214364 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.214336 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:18.214530 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.214452 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 02:32:18.214530 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.214524 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert podName:5e600738-ee08-48fe-aba2-14a2b8540111 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:19.214502983 +0000 UTC m=+229.600425585 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-766cn" (UID: "5e600738-ee08-48fe-aba2-14a2b8540111") : secret "networking-console-plugin-cert" not found Jun 15 02:32:18.315255 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.315156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:18.315255 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.315244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:18.315467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.315306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:18.315467 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315313 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 02:32:18.315467 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315383 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:19.315361828 +0000 UTC m=+229.701284438 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : secret "router-metrics-certs-default" not found Jun 15 02:32:18.315467 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315394 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 02:32:18.315467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.315407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:18.315467 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315428 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:18.315693 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315473 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls podName:904d3d6f-17b0-48d1-870b-835299a7b072 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:19.315458377 +0000 UTC m=+229.701380970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-pwnjc" (UID: "904d3d6f-17b0-48d1-870b-835299a7b072") : secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:18.315693 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315490 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls podName:bc3b2ba8-3fec-4eee-8108-331f94bc7b03 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:19.315480429 +0000 UTC m=+229.701403023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rh2ct" (UID: "bc3b2ba8-3fec-4eee-8108-331f94bc7b03") : secret "samples-operator-tls" not found Jun 15 02:32:18.315693 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:18.315520 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:19.31550807 +0000 UTC m=+229.701430673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : configmap references non-existent config key: service-ca.crt Jun 15 02:32:18.727660 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.727584 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" event={"ID":"1d49b714-3287-43aa-b880-61b5bea8deeb","Type":"ContainerStarted","Data":"bd349f20c74fbd307a25c729a85b58fee4c7689fd428d4d8f9de5469eefb85c8"} Jun 15 02:32:18.729650 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.729615 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" event={"ID":"a0b84785-254c-4a0c-8e5e-cad8056d6e72","Type":"ContainerStarted","Data":"2bbbca612a09dc98f684431ff25108ffba7d8125e2c7b13f123c5dd0b36d2495"} Jun 15 02:32:18.733951 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.733848 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" event={"ID":"e0d15bef-2db6-484f-a7cb-971b06aff1d8","Type":"ContainerStarted","Data":"6401913a457722d55baa2d02ea43e2f5bc4e1c5ca00a533b507803746a5acbb9"} Jun 15 02:32:18.733951 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.733898 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" event={"ID":"e0d15bef-2db6-484f-a7cb-971b06aff1d8","Type":"ContainerStarted","Data":"840602e2814c109ad978565490d187952253a1372427af687a3d6617462f9e64"} Jun 15 02:32:18.735806 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.735782 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" event={"ID":"a3faa307-10ac-46cd-926e-213c889b97fe","Type":"ContainerStarted","Data":"f853819f1eda88dc87796d1cc30db1946056f9d7bacbea8cf6f0a15c72c3ae9d"} Jun 15 02:32:18.748351 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.738635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" event={"ID":"71163f29-58d5-4390-be0d-75104fdd2d79","Type":"ContainerStarted","Data":"5c360e24207b5a14180abaa7a3c9e491f7705391dfac20aff814d8a639a7953c"} Jun 15 02:32:18.750862 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:18.750814 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-s7hkv" podStartSLOduration=1.75079714 podStartE2EDuration="1.75079714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:18.750399397 +0000 UTC m=+229.136322010" watchObservedRunningTime="2026-06-15 02:32:18.75079714 +0000 UTC m=+229.136719752" Jun 15 02:32:19.225928 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.225861 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:19.226132 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.226064 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 02:32:19.226132 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.226129 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert podName:5e600738-ee08-48fe-aba2-14a2b8540111 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:21.226109188 +0000 UTC m=+231.612031777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-766cn" (UID: "5e600738-ee08-48fe-aba2-14a2b8540111") : secret "networking-console-plugin-cert" not found Jun 15 02:32:19.326696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.326657 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:19.326868 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.326716 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:19.326868 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.326780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:19.326868 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.326842 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:21.32682076 +0000 UTC m=+231.712743347 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : configmap references non-existent config key: service-ca.crt Jun 15 02:32:19.326868 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.326857 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 02:32:19.327130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.326896 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:21.326885943 +0000 UTC m=+231.712808544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : secret "router-metrics-certs-default" not found Jun 15 02:32:19.327130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.326895 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 02:32:19.327130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.326953 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls podName:bc3b2ba8-3fec-4eee-8108-331f94bc7b03 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:21.326937324 +0000 UTC m=+231.712859918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rh2ct" (UID: "bc3b2ba8-3fec-4eee-8108-331f94bc7b03") : secret "samples-operator-tls" not found Jun 15 02:32:19.327130 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.326896 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:19.327130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.326964 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:19.327130 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:19.327023 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls podName:904d3d6f-17b0-48d1-870b-835299a7b072 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:21.327005041 +0000 UTC m=+231.712927633 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-pwnjc" (UID: "904d3d6f-17b0-48d1-870b-835299a7b072") : secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:19.743578 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.743495 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" event={"ID":"a0b84785-254c-4a0c-8e5e-cad8056d6e72","Type":"ContainerStarted","Data":"5a9bfedf0e7a6089c890cc5ee1b1563f2b1142f6d5202233b9ce777e0bf8baec"} Jun 15 02:32:19.759300 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.759240 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-p8vsj" podStartSLOduration=1.332722486 podStartE2EDuration="2.759219441s" totalImagesPullingTime="1.426496955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:19.757860426 +0000 UTC m=+230.143783050" watchObservedRunningTime="2026-06-15 02:32:19.759219441 +0000 UTC m=+230.145142052" Jun 15 02:32:19.831802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.831712 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:19.880452 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:19.880421 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:21.244658 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.244616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:21.245126 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.244766 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 02:32:21.245126 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.244842 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert podName:5e600738-ee08-48fe-aba2-14a2b8540111 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.244821395 +0000 UTC m=+235.630743991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-766cn" (UID: "5e600738-ee08-48fe-aba2-14a2b8540111") : secret "networking-console-plugin-cert" not found Jun 15 02:32:21.345193 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.345167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:21.345322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.345209 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:21.345322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.345268 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:21.345322 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345299 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.345278749 +0000 UTC m=+235.731201353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : configmap references non-existent config key: service-ca.crt Jun 15 02:32:21.345510 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345360 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 02:32:21.345510 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345396 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls podName:bc3b2ba8-3fec-4eee-8108-331f94bc7b03 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.345384929 +0000 UTC m=+235.731307531 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rh2ct" (UID: "bc3b2ba8-3fec-4eee-8108-331f94bc7b03") : secret "samples-operator-tls" not found Jun 15 02:32:21.345510 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345401 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 02:32:21.345510 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.345439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:21.345510 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345466 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.34544524 +0000 UTC m=+235.731367833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : secret "router-metrics-certs-default" not found Jun 15 02:32:21.345510 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345494 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:21.345822 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:21.345525 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls podName:904d3d6f-17b0-48d1-870b-835299a7b072 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.345515135 +0000 UTC m=+235.731437728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-pwnjc" (UID: "904d3d6f-17b0-48d1-870b-835299a7b072") : secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:21.752854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.752817 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" event={"ID":"1d49b714-3287-43aa-b880-61b5bea8deeb","Type":"ContainerStarted","Data":"e8d3d0066f7534eb9d9f8e05153e4fa238b55aec4afa052e37b19ea47aa33bb2"} Jun 15 02:32:21.754431 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.754398 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" event={"ID":"a3faa307-10ac-46cd-926e-213c889b97fe","Type":"ContainerStarted","Data":"632700c31978abbce6e4af63f345a72365a51d467dc8ade2965fae33bdfadf37"} Jun 15 02:32:21.755818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.755795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" event={"ID":"71163f29-58d5-4390-be0d-75104fdd2d79","Type":"ContainerStarted","Data":"f71b962140af9a4937d152a43aa3d3c423099a460d7459c6ba23c47f67cc5ec9"} Jun 15 02:32:21.771474 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.771436 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" podStartSLOduration=1.392802981 podStartE2EDuration="4.771426021s" totalImagesPullingTime="3.37862304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:21.770103095 +0000 UTC m=+232.156025707" watchObservedRunningTime="2026-06-15 02:32:21.771426021 +0000 UTC m=+232.157348631" Jun 15 02:32:21.787811 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.787766 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" podStartSLOduration=1.422551202 podStartE2EDuration="4.787753226s" totalImagesPullingTime="3.365202024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:21.78677625 +0000 UTC m=+232.172698860" watchObservedRunningTime="2026-06-15 02:32:21.787753226 +0000 UTC m=+232.173675835" Jun 15 02:32:21.804587 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:21.804528 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" podStartSLOduration=1.569634803 podStartE2EDuration="4.80451048s" totalImagesPullingTime="3.234875677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:21.804218448 +0000 UTC m=+232.190141059" watchObservedRunningTime="2026-06-15 02:32:21.80451048 +0000 UTC m=+232.190433092" Jun 15 02:32:22.406143 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:22.406086 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:22.500824 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:22.500791 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:22.601159 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:22.601120 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:23.334680 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.334637 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k9dxm"] Jun 15 02:32:23.337632 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.337600 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.340601 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.340578 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 02:32:23.340733 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.340651 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jzbf\"" Jun 15 02:32:23.340733 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.340653 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 02:32:23.351519 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.351489 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9dxm"] Jun 15 02:32:23.381558 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.381530 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:23.437600 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.437568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:23.463743 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.463710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnv6b\" (UniqueName: \"kubernetes.io/projected/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-api-access-pnv6b\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.463873 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.463793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6082822-d2f3-48c8-8cea-78561525f3a1-data-volume\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.463873 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.463816 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.463873 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.463848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6082822-d2f3-48c8-8cea-78561525f3a1-crio-socket\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.463970 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.463936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564383 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.564349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6082822-d2f3-48c8-8cea-78561525f3a1-crio-socket\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564548 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.564480 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e6082822-d2f3-48c8-8cea-78561525f3a1-crio-socket\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564548 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.564498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564548 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:23.564488 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 02:32:23.564638 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:23.564559 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:24.06454302 +0000 UTC m=+234.450465610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : configmap "kube-rbac-proxy" not found Jun 15 02:32:23.564638 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.564602 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnv6b\" (UniqueName: \"kubernetes.io/projected/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-api-access-pnv6b\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564710 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.564671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6082822-d2f3-48c8-8cea-78561525f3a1-data-volume\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564710 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.564697 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.564812 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:23.564797 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 02:32:23.564854 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:23.564845 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:24.064831698 +0000 UTC m=+234.450754293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : secret "insights-runtime-extractor-tls" not found Jun 15 02:32:23.565049 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.565034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e6082822-d2f3-48c8-8cea-78561525f3a1-data-volume\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:23.573092 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:23.573070 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnv6b\" (UniqueName: \"kubernetes.io/projected/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-api-access-pnv6b\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:24.067910 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:24.067872 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:24.068114 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:24.067954 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:24.068114 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:24.068029 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 02:32:24.068114 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:24.068056 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 02:32:24.068114 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:24.068096 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.068079874 +0000 UTC m=+235.454002462 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : secret "insights-runtime-extractor-tls" not found Jun 15 02:32:24.068114 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:24.068111 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:25.068104995 +0000 UTC m=+235.454027583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : configmap "kube-rbac-proxy" not found Jun 15 02:32:24.477135 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:24.477104 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:24.533577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:24.533547 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:24.975928 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:24.975891 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:25.077179 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.077145 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:25.077314 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.077221 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:25.077359 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.077311 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:25.077359 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.077326 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 02:32:25.077447 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.077374 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:27.077358248 +0000 UTC m=+237.463280840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : configmap "kube-rbac-proxy" not found Jun 15 02:32:25.077447 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.077428 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 02:32:25.077551 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.077469 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:27.07745856 +0000 UTC m=+237.463381151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : secret "insights-runtime-extractor-tls" not found Jun 15 02:32:25.184336 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.184302 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:25.279336 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.279256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:25.279458 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.279396 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 02:32:25.279458 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.279452 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert podName:5e600738-ee08-48fe-aba2-14a2b8540111 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:33.279439064 +0000 UTC m=+243.665361656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-766cn" (UID: "5e600738-ee08-48fe-aba2-14a2b8540111") : secret "networking-console-plugin-cert" not found Jun 15 02:32:25.284116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.284088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:25.380405 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.380365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:25.380560 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.380431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:25.380560 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.380476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:25.380560 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.380495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:25.380560 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380500 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 15 02:32:25.380560 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380553 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls podName:bc3b2ba8-3fec-4eee-8108-331f94bc7b03 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:33.380538524 +0000 UTC m=+243.766461116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls") pod "cluster-samples-operator-9547488fd-rh2ct" (UID: "bc3b2ba8-3fec-4eee-8108-331f94bc7b03") : secret "samples-operator-tls" not found Jun 15 02:32:25.380779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380580 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 15 02:32:25.380779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380617 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:33.38060139 +0000 UTC m=+243.766523983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : configmap references non-existent config key: service-ca.crt Jun 15 02:32:25.380779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380626 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:25.380779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380637 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:33.380630555 +0000 UTC m=+243.766553143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : secret "router-metrics-certs-default" not found Jun 15 02:32:25.380779 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:25.380654 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls podName:904d3d6f-17b0-48d1-870b-835299a7b072 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:33.3806437 +0000 UTC m=+243.766566288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-pwnjc" (UID: "904d3d6f-17b0-48d1-870b-835299a7b072") : secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:25.943033 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:25.942984 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-74mjb_409968b6-a03b-4caf-b7df-e03d50603795/dns-node-resolver/0.log" Jun 15 02:32:26.775295 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.775265 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-fd5td"] Jun 15 02:32:26.777330 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.777310 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.780024 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.780003 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 15 02:32:26.780024 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.780027 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 15 02:32:26.780239 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.780026 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 15 02:32:26.781424 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.781404 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 15 02:32:26.781492 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.781457 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5nf9k\"" Jun 15 02:32:26.787314 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.787291 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-fd5td"] Jun 15 02:32:26.806622 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.806570 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:26.892342 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.892304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-signing-key\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.892503 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.892357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvwds\" (UniqueName: \"kubernetes.io/projected/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-kube-api-access-rvwds\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.892544 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.892501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-signing-cabundle\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.942847 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.942822 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2g55p_622691a5-4cab-449f-9e46-79aa9c1ce23f/node-ca/0.log" Jun 15 02:32:26.993110 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.993036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvwds\" (UniqueName: \"kubernetes.io/projected/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-kube-api-access-rvwds\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.993440 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.993163 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-signing-cabundle\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.993440 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.993192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-signing-key\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.993807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.993788 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-signing-cabundle\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:26.995567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:26.995550 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-signing-key\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:27.001042 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.001015 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvwds\" (UniqueName: \"kubernetes.io/projected/5330bd2d-64a9-44fc-88c2-3aaf20370dcf-kube-api-access-rvwds\") pod \"service-ca-7b994bc59-fd5td\" (UID: \"5330bd2d-64a9-44fc-88c2-3aaf20370dcf\") " pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:27.087011 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.086934 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-fd5td" Jun 15 02:32:27.094334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.094309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:27.094442 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.094425 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:27.094502 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:27.094484 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 02:32:27.094559 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:27.094541 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 02:32:27.094597 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:27.094557 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:31.094537754 +0000 UTC m=+241.480460344 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : secret "insights-runtime-extractor-tls" not found Jun 15 02:32:27.094650 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:27.094598 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:31.094582182 +0000 UTC m=+241.480504774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : configmap "kube-rbac-proxy" not found Jun 15 02:32:27.211239 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.211210 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-fd5td"] Jun 15 02:32:27.213960 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:27.213935 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5330bd2d_64a9_44fc_88c2_3aaf20370dcf.slice/crio-5d2a279d0639560ed500c0f503b61d1959201202f94e819f2fd7ae43d400d274 WatchSource:0}: Error finding container 5d2a279d0639560ed500c0f503b61d1959201202f94e819f2fd7ae43d400d274: Status 404 returned error can't find the container with id 5d2a279d0639560ed500c0f503b61d1959201202f94e819f2fd7ae43d400d274 Jun 15 02:32:27.654281 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.654203 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:27.744204 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.744175 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dz8b9_cc301e02-5d66-4ee7-8e02-9a3732ac2bab/serve-healthcheck-canary/0.log" Jun 15 02:32:27.775252 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.775213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-fd5td" event={"ID":"5330bd2d-64a9-44fc-88c2-3aaf20370dcf","Type":"ContainerStarted","Data":"207dad76fb5351a976778d71e37adfb33158da3f51a7d3847a2df92019561d1a"} Jun 15 02:32:27.775396 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.775274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-fd5td" event={"ID":"5330bd2d-64a9-44fc-88c2-3aaf20370dcf","Type":"ContainerStarted","Data":"5d2a279d0639560ed500c0f503b61d1959201202f94e819f2fd7ae43d400d274"} Jun 15 02:32:27.797042 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:27.796978 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-fd5td" podStartSLOduration=1.796958214 podStartE2EDuration="1.796958214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:27.795561018 +0000 UTC m=+238.181483639" watchObservedRunningTime="2026-06-15 02:32:27.796958214 +0000 UTC m=+238.182880826" Jun 15 02:32:28.393260 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:28.393230 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:28.524766 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:28.524727 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:28.628646 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:28.628615 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:28.727524 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:28.727491 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:28.743785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:28.743758 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-xkcbj_a3faa307-10ac-46cd-926e-213c889b97fe/kube-storage-version-migrator-operator/0.log" Jun 15 02:32:28.790409 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:28.790373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:29.089105 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:29.089018 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:30.074699 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:30.074650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:30.174956 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:30.174925 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:30.290361 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:30.290336 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:30.680874 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:30.680839 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:30.889847 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:30.889814 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:31.127078 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:31.126979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:31.127458 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:31.127097 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:31.127458 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:31.127139 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 15 02:32:31.127458 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:31.127201 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 15 02:32:31.127458 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:31.127209 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:39.12719024 +0000 UTC m=+249.513112830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : secret "insights-runtime-extractor-tls" not found Jun 15 02:32:31.127458 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:31.127235 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm podName:e6082822-d2f3-48c8-8cea-78561525f3a1 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:39.127225478 +0000 UTC m=+249.513148066 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-k9dxm" (UID: "e6082822-d2f3-48c8-8cea-78561525f3a1") : configmap "kube-rbac-proxy" not found Jun 15 02:32:31.283763 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:31.283734 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:31.341229 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:31.341195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:31.883509 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:31.883474 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:32.275054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:32.275020 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:32.323722 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:32.323691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:32.479940 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:32.479907 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:32.674774 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:32.674743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:33.076471 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.076395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:33.125787 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.125757 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:33.275417 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.275382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:33.346175 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.346094 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:33.346328 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:33.346262 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 15 02:32:33.346382 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:33.346339 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert podName:5e600738-ee08-48fe-aba2-14a2b8540111 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:49.346318016 +0000 UTC m=+259.732240625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert") pod "networking-console-plugin-867b76cb74-766cn" (UID: "5e600738-ee08-48fe-aba2-14a2b8540111") : secret "networking-console-plugin-cert" not found Jun 15 02:32:33.446905 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.446868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:33.447101 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.446927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:33.447101 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.446977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:33.447101 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.447017 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:33.447263 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:33.447130 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:33.447263 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:33.447194 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle podName:9631d33a-8f79-4f1e-b1f2-80a9137ab308 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:49.44717146 +0000 UTC m=+259.833094055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle") pod "router-default-65dd75fbbd-wbt2h" (UID: "9631d33a-8f79-4f1e-b1f2-80a9137ab308") : configmap references non-existent config key: service-ca.crt Jun 15 02:32:33.447263 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:32:33.447220 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls podName:904d3d6f-17b0-48d1-870b-835299a7b072 nodeName:}" failed. No retries permitted until 2026-06-15 02:32:49.447210968 +0000 UTC m=+259.833133559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-pwnjc" (UID: "904d3d6f-17b0-48d1-870b-835299a7b072") : secret "cluster-monitoring-operator-tls" not found Jun 15 02:32:33.449644 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.449617 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/bc3b2ba8-3fec-4eee-8108-331f94bc7b03-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-rh2ct\" (UID: \"bc3b2ba8-3fec-4eee-8108-331f94bc7b03\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:33.449747 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.449650 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9631d33a-8f79-4f1e-b1f2-80a9137ab308-metrics-certs\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:33.531965 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.531937 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-8hnbf\"" Jun 15 02:32:33.540386 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.540366 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" Jun 15 02:32:33.674144 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.674115 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct"] Jun 15 02:32:33.797868 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.797829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" event={"ID":"bc3b2ba8-3fec-4eee-8108-331f94bc7b03","Type":"ContainerStarted","Data":"fc3f7696e4d9a734e45269cbc7ac07843462cf12affad8ddf4746dde81cbc185"} Jun 15 02:32:33.878617 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:33.878548 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:34.074788 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:34.074759 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:34.480761 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:34.480729 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:34.528570 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:34.528535 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:34.803072 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:34.803003 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:35.276972 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.276935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:35.447314 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.447273 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:35.675420 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.675388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:35.807121 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.807089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" event={"ID":"bc3b2ba8-3fec-4eee-8108-331f94bc7b03","Type":"ContainerStarted","Data":"f1b0ca985ba156721c5d748323d58602d91a4c0fb594d1df9db5436c06b33baf"} Jun 15 02:32:35.807311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.807142 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" event={"ID":"bc3b2ba8-3fec-4eee-8108-331f94bc7b03","Type":"ContainerStarted","Data":"0bb1825d538a5b8bb003382aa07e080102da5797a79c82b0b74765bfec6f0ea3"} Jun 15 02:32:35.825606 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.825516 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-rh2ct" podStartSLOduration=16.98348226 podStartE2EDuration="18.825500635s" totalImagesPullingTime="1.842018375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:35.824883106 +0000 UTC m=+246.210805716" watchObservedRunningTime="2026-06-15 02:32:35.825500635 +0000 UTC m=+246.211423245" Jun 15 02:32:35.877477 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:35.877445 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:36.074375 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:36.074325 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:36.267442 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:36.267414 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:36.318711 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:36.318689 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:37.478753 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:37.478717 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:37.679617 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:37.679567 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:37.903616 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:37.903509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:38.078526 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:38.078473 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:38.277120 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:38.277088 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:38.874614 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:38.874581 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:39.087903 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.087874 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:39.198354 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.198329 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:39.198507 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.198393 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:39.199038 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.199017 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e6082822-d2f3-48c8-8cea-78561525f3a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:39.201074 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.201045 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e6082822-d2f3-48c8-8cea-78561525f3a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k9dxm\" (UID: \"e6082822-d2f3-48c8-8cea-78561525f3a1\") " pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:39.257467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.257446 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6jzbf\"" Jun 15 02:32:39.265572 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.265554 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k9dxm" Jun 15 02:32:39.431595 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.431503 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k9dxm"] Jun 15 02:32:39.434135 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:39.434107 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6082822_d2f3_48c8_8cea_78561525f3a1.slice/crio-fdae679c66a07c9105cf6d5f4fc85d3bea44c9b91c9b3e3b454df841375793d5 WatchSource:0}: Error finding container fdae679c66a07c9105cf6d5f4fc85d3bea44c9b91c9b3e3b454df841375793d5: Status 404 returned error can't find the container with id fdae679c66a07c9105cf6d5f4fc85d3bea44c9b91c9b3e3b454df841375793d5 Jun 15 02:32:39.819269 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:39.819234 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9dxm" event={"ID":"e6082822-d2f3-48c8-8cea-78561525f3a1","Type":"ContainerStarted","Data":"fdae679c66a07c9105cf6d5f4fc85d3bea44c9b91c9b3e3b454df841375793d5"} Jun 15 02:32:40.476947 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:40.476915 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:40.578417 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:40.578378 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:41.439199 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:41.439164 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:41.540701 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:41.540667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:41.590694 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:41.590652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:41.743095 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:41.743004 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:41.925401 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:41.925366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:32:41.928152 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:41.928130 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8852e474-0727-45d4-93c0-67ea29e0fe6a-metrics-certs\") pod \"network-metrics-daemon-nx5lh\" (UID: \"8852e474-0727-45d4-93c0-67ea29e0fe6a\") " pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:32:42.128127 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:42.128056 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:42.176567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:42.176536 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:42.182816 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:42.182790 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j9gzq\"" Jun 15 02:32:42.191210 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:42.191190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nx5lh" Jun 15 02:32:42.747305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:42.747271 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:42.953462 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:42.953399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:43.011705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.011682 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nx5lh"] Jun 15 02:32:43.014628 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:43.014587 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8852e474_0727_45d4_93c0_67ea29e0fe6a.slice/crio-250ef18b14f18b0bd8f6a077195011136820d1f69825d9c3c7fa52b1dbfce69e WatchSource:0}: Error finding container 250ef18b14f18b0bd8f6a077195011136820d1f69825d9c3c7fa52b1dbfce69e: Status 404 returned error can't find the container with id 250ef18b14f18b0bd8f6a077195011136820d1f69825d9c3c7fa52b1dbfce69e Jun 15 02:32:43.016632 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.016529 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:43.335724 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.335647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:43.497223 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.497157 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:43.597390 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.597348 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:43.835966 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.835934 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9dxm" event={"ID":"e6082822-d2f3-48c8-8cea-78561525f3a1","Type":"ContainerStarted","Data":"e42bc308030a0b8cd24c93870e8cfd854168c1efc33173dfd7dcfc064afb2d8f"} Jun 15 02:32:43.836374 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.836011 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9dxm" event={"ID":"e6082822-d2f3-48c8-8cea-78561525f3a1","Type":"ContainerStarted","Data":"92f47a15300b38d9626e0351c8eea8e88c246370ab1dc9361a94ef2044d993f6"} Jun 15 02:32:43.836889 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:43.836869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nx5lh" event={"ID":"8852e474-0727-45d4-93c0-67ea29e0fe6a","Type":"ContainerStarted","Data":"250ef18b14f18b0bd8f6a077195011136820d1f69825d9c3c7fa52b1dbfce69e"} Jun 15 02:32:44.847748 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:44.847706 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nx5lh" event={"ID":"8852e474-0727-45d4-93c0-67ea29e0fe6a","Type":"ContainerStarted","Data":"4c9fb5102ac229a5bcf500c1453ddd8bc556244e60cc25264218deca03b955b3"} Jun 15 02:32:44.848206 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:44.847805 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nx5lh" event={"ID":"8852e474-0727-45d4-93c0-67ea29e0fe6a","Type":"ContainerStarted","Data":"c90e7d7091a1aeef8dc5695370f0ade40d0f5bd3874d3bee806dfb8a8e722e06"} Jun 15 02:32:44.863798 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:44.863750 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nx5lh" podStartSLOduration=253.999845532 podStartE2EDuration="4m14.863737447s" totalImagesPullingTime="863.891915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:44.862460837 +0000 UTC m=+255.248383448" watchObservedRunningTime="2026-06-15 02:32:44.863737447 +0000 UTC m=+255.249660057" Jun 15 02:32:45.152480 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:45.152410 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:45.253461 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:45.253437 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:45.852374 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:45.852340 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k9dxm" event={"ID":"e6082822-d2f3-48c8-8cea-78561525f3a1","Type":"ContainerStarted","Data":"0e9e90a685aee89c05881eb5a6745e51c6eafd6e3609314b897541593f088a6e"} Jun 15 02:32:45.871032 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:45.870970 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k9dxm" podStartSLOduration=17.220251249 podStartE2EDuration="22.870955091s" totalImagesPullingTime="5.650703842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:32:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:45.868601294 +0000 UTC m=+256.254523903" watchObservedRunningTime="2026-06-15 02:32:45.870955091 +0000 UTC m=+256.256877700" Jun 15 02:32:49.146392 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.146319 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-9fs7c"] Jun 15 02:32:49.149666 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.149650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:32:49.152500 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.152478 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 02:32:49.152600 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.152498 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wqxnf\"" Jun 15 02:32:49.152600 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.152498 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 02:32:49.162703 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.162674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-9fs7c"] Jun 15 02:32:49.178913 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.178887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xd56\" (UniqueName: \"kubernetes.io/projected/e90f45c7-9e12-4579-9e72-98c96463e2c9-kube-api-access-7xd56\") pod \"downloads-694c955b9-9fs7c\" (UID: \"e90f45c7-9e12-4579-9e72-98c96463e2c9\") " pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:32:49.272543 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.272498 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:49.279737 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.279707 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xd56\" (UniqueName: \"kubernetes.io/projected/e90f45c7-9e12-4579-9e72-98c96463e2c9-kube-api-access-7xd56\") pod \"downloads-694c955b9-9fs7c\" (UID: \"e90f45c7-9e12-4579-9e72-98c96463e2c9\") " pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:32:49.288896 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.288870 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xd56\" (UniqueName: \"kubernetes.io/projected/e90f45c7-9e12-4579-9e72-98c96463e2c9-kube-api-access-7xd56\") pod \"downloads-694c955b9-9fs7c\" (UID: \"e90f45c7-9e12-4579-9e72-98c96463e2c9\") " pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:32:49.372239 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.372202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:49.380347 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.380318 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:49.382667 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.382644 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/5e600738-ee08-48fe-aba2-14a2b8540111-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-766cn\" (UID: \"5e600738-ee08-48fe-aba2-14a2b8540111\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:49.458731 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.458709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:32:49.481641 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.481614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:49.481876 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.481669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:49.482266 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.482247 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9631d33a-8f79-4f1e-b1f2-80a9137ab308-service-ca-bundle\") pod \"router-default-65dd75fbbd-wbt2h\" (UID: \"9631d33a-8f79-4f1e-b1f2-80a9137ab308\") " pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:49.484115 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.484094 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/904d3d6f-17b0-48d1-870b-835299a7b072-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-pwnjc\" (UID: \"904d3d6f-17b0-48d1-870b-835299a7b072\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:49.587673 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.587557 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-9fs7c"] Jun 15 02:32:49.590095 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:49.590066 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90f45c7_9e12_4579_9e72_98c96463e2c9.slice/crio-8d5a48add11afe718aed8c1da25fc4631bc4b8d43d6be2a9b30a02c6f5e87736 WatchSource:0}: Error finding container 8d5a48add11afe718aed8c1da25fc4631bc4b8d43d6be2a9b30a02c6f5e87736: Status 404 returned error can't find the container with id 8d5a48add11afe718aed8c1da25fc4631bc4b8d43d6be2a9b30a02c6f5e87736 Jun 15 02:32:49.630009 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.629978 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-trd6z\"" Jun 15 02:32:49.638341 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.638325 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" Jun 15 02:32:49.724779 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.724756 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-d87xn\"" Jun 15 02:32:49.733072 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.733048 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" Jun 15 02:32:49.742466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.742445 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-4852h\"" Jun 15 02:32:49.750605 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.750574 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:49.762045 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.762022 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-766cn"] Jun 15 02:32:49.764278 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:49.764255 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e600738_ee08_48fe_aba2_14a2b8540111.slice/crio-21758f84675650b69eab1beebe22570639d13cf040ac7c63c0ee5f60b21cd3f7 WatchSource:0}: Error finding container 21758f84675650b69eab1beebe22570639d13cf040ac7c63c0ee5f60b21cd3f7: Status 404 returned error can't find the container with id 21758f84675650b69eab1beebe22570639d13cf040ac7c63c0ee5f60b21cd3f7 Jun 15 02:32:49.867499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.867466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" event={"ID":"5e600738-ee08-48fe-aba2-14a2b8540111","Type":"ContainerStarted","Data":"21758f84675650b69eab1beebe22570639d13cf040ac7c63c0ee5f60b21cd3f7"} Jun 15 02:32:49.868361 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.868335 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc"] Jun 15 02:32:49.868815 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.868795 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-9fs7c" event={"ID":"e90f45c7-9e12-4579-9e72-98c96463e2c9","Type":"ContainerStarted","Data":"8d5a48add11afe718aed8c1da25fc4631bc4b8d43d6be2a9b30a02c6f5e87736"} Jun 15 02:32:49.871528 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:49.871503 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904d3d6f_17b0_48d1_870b_835299a7b072.slice/crio-e9d722c80b30016850b1735d32478680fe20ce8ef03124a6dde3cff39ebab801 WatchSource:0}: Error finding container e9d722c80b30016850b1735d32478680fe20ce8ef03124a6dde3cff39ebab801: Status 404 returned error can't find the container with id e9d722c80b30016850b1735d32478680fe20ce8ef03124a6dde3cff39ebab801 Jun 15 02:32:49.889818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:49.889797 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-65dd75fbbd-wbt2h"] Jun 15 02:32:49.892065 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:32:49.892043 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9631d33a_8f79_4f1e_b1f2_80a9137ab308.slice/crio-a55ca4eba611b7bae3f5a5a52654d9e33fc5d78ce6d1473e21372dd3c2412c4e WatchSource:0}: Error finding container a55ca4eba611b7bae3f5a5a52654d9e33fc5d78ce6d1473e21372dd3c2412c4e: Status 404 returned error can't find the container with id a55ca4eba611b7bae3f5a5a52654d9e33fc5d78ce6d1473e21372dd3c2412c4e Jun 15 02:32:50.876490 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:50.876116 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" event={"ID":"9631d33a-8f79-4f1e-b1f2-80a9137ab308","Type":"ContainerStarted","Data":"e47e8a5d7c27f7cf520fe69564bb7bfdb91c74754e627cca8ed2a95967a12f88"} Jun 15 02:32:50.876490 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:50.876207 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" event={"ID":"9631d33a-8f79-4f1e-b1f2-80a9137ab308","Type":"ContainerStarted","Data":"a55ca4eba611b7bae3f5a5a52654d9e33fc5d78ce6d1473e21372dd3c2412c4e"} Jun 15 02:32:50.878031 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:50.877953 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" event={"ID":"904d3d6f-17b0-48d1-870b-835299a7b072","Type":"ContainerStarted","Data":"e9d722c80b30016850b1735d32478680fe20ce8ef03124a6dde3cff39ebab801"} Jun 15 02:32:50.895892 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:50.895836 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" podStartSLOduration=33.895817273 podStartE2EDuration="33.895817273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:50.894540216 +0000 UTC m=+261.280462826" watchObservedRunningTime="2026-06-15 02:32:50.895817273 +0000 UTC m=+261.281739905" Jun 15 02:32:51.751746 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.751697 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:51.754504 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.754482 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:51.883325 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.883285 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" event={"ID":"904d3d6f-17b0-48d1-870b-835299a7b072","Type":"ContainerStarted","Data":"4d53710d22b77a404cfea215bbb3ca2a4d2001965e2671195b0d5354536925aa"} Jun 15 02:32:51.885079 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.885051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" event={"ID":"5e600738-ee08-48fe-aba2-14a2b8540111","Type":"ContainerStarted","Data":"96c43ae634543cbcad5ad70f6d494a74e5a4c61ffb0b3f03cf428eac0a728fce"} Jun 15 02:32:51.885196 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.885100 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:51.886429 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.886401 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-65dd75fbbd-wbt2h" Jun 15 02:32:51.900818 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:51.900775 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-pwnjc" podStartSLOduration=33.004024959 podStartE2EDuration="34.900762615s" totalImagesPullingTime="1.896737656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:51.899734781 +0000 UTC m=+262.285657390" watchObservedRunningTime="2026-06-15 02:32:51.900762615 +0000 UTC m=+262.286685225" Jun 15 02:32:52.038322 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:52.038292 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:52.134558 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:52.134523 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:52.260043 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:52.260013 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:52.320748 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:52.320676 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:55.549568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:55.549532 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:55.603536 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:55.603507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:56.279894 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:56.279861 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:56.348760 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:56.348726 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:56.706407 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:56.706369 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:57.951431 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:57.951395 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:58.005361 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:58.005311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:32:58.857953 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:32:58.857918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:01.401612 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.401582 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:01.625274 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.625191 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:01.651221 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.651096 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-766cn" podStartSLOduration=43.350046568 podStartE2EDuration="44.651074166s" totalImagesPullingTime="1.301027598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:32:51.937057865 +0000 UTC m=+262.322980475" watchObservedRunningTime="2026-06-15 02:33:01.651074166 +0000 UTC m=+272.036996774" Jun 15 02:33:01.654604 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.653142 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg"] Jun 15 02:33:01.658584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.658558 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.662711 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.661965 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 02:33:01.663118 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.662093 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 02:33:01.669223 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.669200 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-22x2c\"" Jun 15 02:33:01.673773 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.672280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg"] Jun 15 02:33:01.675102 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.675081 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 02:33:01.675249 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.675228 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 02:33:01.685501 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.685130 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cr2pz"] Jun 15 02:33:01.688591 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.688569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.690935 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.690861 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 02:33:01.691252 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.691234 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 02:33:01.692835 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.691417 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s4z92\"" Jun 15 02:33:01.692835 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.691496 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 02:33:01.696582 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.696528 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:01.781922 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.781887 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-textfile\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.781927 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.781957 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/befd20b5-9cb7-4c0d-977c-f421817b378e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.782122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.781979 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a839b417-c759-419c-ad89-091ee9de286f-metrics-client-ca\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.782122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782073 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-root\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782099 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-wtmp\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782125 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/befd20b5-9cb7-4c0d-977c-f421817b378e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782235 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-sys\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782279 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782305 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mg58\" (UniqueName: \"kubernetes.io/projected/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-api-access-9mg58\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-tls\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhl9d\" (UniqueName: \"kubernetes.io/projected/a839b417-c759-419c-ad89-091ee9de286f-kube-api-access-rhl9d\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.782419 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.782392 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.790760 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.790736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:01.883074 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/befd20b5-9cb7-4c0d-977c-f421817b378e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.883236 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883084 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a839b417-c759-419c-ad89-091ee9de286f-metrics-client-ca\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883236 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.883366 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-root\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883366 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883286 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-wtmp\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883366 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883366 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883352 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/befd20b5-9cb7-4c0d-977c-f421817b378e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.883567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883397 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-sys\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.883567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883456 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mg58\" (UniqueName: \"kubernetes.io/projected/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-api-access-9mg58\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.883567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883482 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-tls\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhl9d\" (UniqueName: \"kubernetes.io/projected/a839b417-c759-419c-ad89-091ee9de286f-kube-api-access-rhl9d\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.883844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883622 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-textfile\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-sys\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a839b417-c759-419c-ad89-091ee9de286f-metrics-client-ca\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.883844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883816 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/befd20b5-9cb7-4c0d-977c-f421817b378e-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.884182 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.883966 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/befd20b5-9cb7-4c0d-977c-f421817b378e-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.884182 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.884107 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-root\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.884357 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.884309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-accelerators-collector-config\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.884487 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.884425 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-wtmp\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.884691 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.884631 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-textfile\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.884691 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.884642 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.887184 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.887123 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-tls\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.887606 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.887557 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.887871 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.887833 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.888729 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.888702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a839b417-c759-419c-ad89-091ee9de286f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.889885 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.889848 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:01.892495 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.892473 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhl9d\" (UniqueName: \"kubernetes.io/projected/a839b417-c759-419c-ad89-091ee9de286f-kube-api-access-rhl9d\") pod \"node-exporter-cr2pz\" (UID: \"a839b417-c759-419c-ad89-091ee9de286f\") " pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:01.892631 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.892606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mg58\" (UniqueName: \"kubernetes.io/projected/befd20b5-9cb7-4c0d-977c-f421817b378e-kube-api-access-9mg58\") pod \"kube-state-metrics-678bc549d7-8bvbg\" (UID: \"befd20b5-9cb7-4c0d-977c-f421817b378e\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.986009 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.985954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" Jun 15 02:33:01.989640 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:01.989599 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:02.001398 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.001371 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cr2pz" Jun 15 02:33:02.089837 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.089794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:02.310091 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.310005 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:02.411201 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.411170 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:02.511931 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.511878 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:02.646667 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.646579 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:02.735524 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:02.735494 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:03.371708 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:03.371677 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:04.609210 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.609172 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:04.628687 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.628662 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f987994b9-zp9lb"] Jun 15 02:33:04.633120 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.633098 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636103 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636103 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636160 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636276 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636413 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636511 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-80712gun46he9\"" Jun 15 02:33:04.636705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.636588 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-crcm4\"" Jun 15 02:33:04.643800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.643777 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f987994b9-zp9lb"] Jun 15 02:33:04.672307 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.672274 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:04.709379 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709510 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709450 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f4d5b5-e850-482d-8f58-da6b4dec9905-metrics-client-ca\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709510 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709626 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709522 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709626 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-grpc-tls\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709626 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-tls\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709642 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.709772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.709688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch6jn\" (UniqueName: \"kubernetes.io/projected/a5f4d5b5-e850-482d-8f58-da6b4dec9905-kube-api-access-ch6jn\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.721273 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.721242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:04.810854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.810819 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.810854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.810859 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch6jn\" (UniqueName: \"kubernetes.io/projected/a5f4d5b5-e850-482d-8f58-da6b4dec9905-kube-api-access-ch6jn\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.810893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.810969 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f4d5b5-e850-482d-8f58-da6b4dec9905-metrics-client-ca\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.811037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.811072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.811100 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-grpc-tls\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811359 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.811126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-tls\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.811982 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.811956 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5f4d5b5-e850-482d-8f58-da6b4dec9905-metrics-client-ca\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.814386 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.814360 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.814486 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.814360 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.814874 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.814853 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.816395 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.816376 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-tls\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.816513 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.815929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.816933 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.816907 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a5f4d5b5-e850-482d-8f58-da6b4dec9905-secret-grpc-tls\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.819605 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.819586 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch6jn\" (UniqueName: \"kubernetes.io/projected/a5f4d5b5-e850-482d-8f58-da6b4dec9905-kube-api-access-ch6jn\") pod \"thanos-querier-5f987994b9-zp9lb\" (UID: \"a5f4d5b5-e850-482d-8f58-da6b4dec9905\") " pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:04.946132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:04.946098 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:05.364116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:05.364037 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:06.160656 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.160588 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:06.261554 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.261515 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:06.426275 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.426150 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:06.434382 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.434357 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf"] Jun 15 02:33:06.439713 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.439684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.444229 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.444170 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-774fk\"" Jun 15 02:33:06.444229 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.444215 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 02:33:06.444531 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.444299 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf"] Jun 15 02:33:06.524144 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.524098 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:06.526220 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.526189 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82zfl\" (UniqueName: \"kubernetes.io/projected/80ad6dc9-b33c-4f59-bbf1-201eb318f9ba-kube-api-access-82zfl\") pod \"monitoring-plugin-589576dfc7-h5vcf\" (UID: \"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.526318 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.526222 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ad6dc9-b33c-4f59-bbf1-201eb318f9ba-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h5vcf\" (UID: \"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.626157 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.626119 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:06.627184 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.627161 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82zfl\" (UniqueName: \"kubernetes.io/projected/80ad6dc9-b33c-4f59-bbf1-201eb318f9ba-kube-api-access-82zfl\") pod \"monitoring-plugin-589576dfc7-h5vcf\" (UID: \"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.627276 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.627202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ad6dc9-b33c-4f59-bbf1-201eb318f9ba-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h5vcf\" (UID: \"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.630082 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.630059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/80ad6dc9-b33c-4f59-bbf1-201eb318f9ba-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h5vcf\" (UID: \"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.635929 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.635904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82zfl\" (UniqueName: \"kubernetes.io/projected/80ad6dc9-b33c-4f59-bbf1-201eb318f9ba-kube-api-access-82zfl\") pod \"monitoring-plugin-589576dfc7-h5vcf\" (UID: \"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:06.751811 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:06.751731 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:07.820527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.820492 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 02:33:07.823494 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.823464 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:07.824893 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.824875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.827823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.827780 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 02:33:07.827823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.827811 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 02:33:07.828020 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.827862 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 02:33:07.828222 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.828200 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 02:33:07.828412 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.828330 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 02:33:07.828412 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.828344 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 02:33:07.831554 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831221 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rv7vw\"" Jun 15 02:33:07.831554 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831258 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 02:33:07.831554 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831375 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3oe8pu0d1109k\"" Jun 15 02:33:07.831554 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831457 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 02:33:07.831801 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831647 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 02:33:07.831801 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831664 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 02:33:07.831900 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 02:33:07.831900 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831878 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 02:33:07.832014 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.831941 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 02:33:07.832308 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.832200 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 02:33:07.833424 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.833240 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 02:33:07.841335 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.841306 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 02:33:07.939145 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939145 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxvc\" (UniqueName: \"kubernetes.io/projected/88982110-7082-4c09-bf5e-e85e4e779638-kube-api-access-dnxvc\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939321 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939355 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939390 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939475 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939576 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939582 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88982110-7082-4c09-bf5e-e85e4e779638-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939656 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939697 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-config\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.939772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939725 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.940033 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939803 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88982110-7082-4c09-bf5e-e85e4e779638-config-out\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.940033 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.940033 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939872 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:07.940033 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:07.939895 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-web-config\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040379 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88982110-7082-4c09-bf5e-e85e4e779638-config-out\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040427 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040450 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-web-config\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040499 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040524 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxvc\" (UniqueName: \"kubernetes.io/projected/88982110-7082-4c09-bf5e-e85e4e779638-kube-api-access-dnxvc\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040584 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040584 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040735 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040780 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.040944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.040811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.041915 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.041693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.041915 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.041812 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.042336 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.043325 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.043853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88982110-7082-4c09-bf5e-e85e4e779638-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.043902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.043906 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.043948 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-config\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.044525 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.043980 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.045912 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.045742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-web-config\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.045912 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.045850 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046105 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.045919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88982110-7082-4c09-bf5e-e85e4e779638-config-out\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046105 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.045979 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046225 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.046198 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046332 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.046312 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046638 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.046578 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.046748 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88982110-7082-4c09-bf5e-e85e4e779638-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.046937 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.046891 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.047226 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.047204 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.047558 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.047531 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.048634 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.048613 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88982110-7082-4c09-bf5e-e85e4e779638-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.049244 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.049226 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-config\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.049832 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.049788 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxvc\" (UniqueName: \"kubernetes.io/projected/88982110-7082-4c09-bf5e-e85e4e779638-kube-api-access-dnxvc\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.049974 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.049955 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88982110-7082-4c09-bf5e-e85e4e779638-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88982110-7082-4c09-bf5e-e85e4e779638\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:08.136933 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:08.136851 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:09.227210 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:33:09.227104 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda839b417_c759_419c_ad89_091ee9de286f.slice/crio-8a0c33f5124573235578f3c4680a85430b971ccd99cb85a1c7da50263b755975 WatchSource:0}: Error finding container 8a0c33f5124573235578f3c4680a85430b971ccd99cb85a1c7da50263b755975: Status 404 returned error can't find the container with id 8a0c33f5124573235578f3c4680a85430b971ccd99cb85a1c7da50263b755975 Jun 15 02:33:09.388285 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.388257 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf"] Jun 15 02:33:09.621182 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.621143 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg"] Jun 15 02:33:09.623536 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:33:09.623504 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbefd20b5_9cb7_4c0d_977c_f421817b378e.slice/crio-e1c1d10f9aef63539b6e5278b7a2a13b194d6c147b5ccb097b866f6ed9fd76c6 WatchSource:0}: Error finding container e1c1d10f9aef63539b6e5278b7a2a13b194d6c147b5ccb097b866f6ed9fd76c6: Status 404 returned error can't find the container with id e1c1d10f9aef63539b6e5278b7a2a13b194d6c147b5ccb097b866f6ed9fd76c6 Jun 15 02:33:09.626941 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.626907 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f987994b9-zp9lb"] Jun 15 02:33:09.630742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.630702 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 02:33:09.633494 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:33:09.633378 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f4d5b5_e850_482d_8f58_da6b4dec9905.slice/crio-ce270597656a148dbeed6188edd95f284699455ad92058acc2b4768e5d075931 WatchSource:0}: Error finding container ce270597656a148dbeed6188edd95f284699455ad92058acc2b4768e5d075931: Status 404 returned error can't find the container with id ce270597656a148dbeed6188edd95f284699455ad92058acc2b4768e5d075931 Jun 15 02:33:09.634536 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:33:09.634490 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88982110_7082_4c09_bf5e_e85e4e779638.slice/crio-203da5c55c02bccda8add902d3a7055b155c0727d4316e06c7f711dc8e50db3d WatchSource:0}: Error finding container 203da5c55c02bccda8add902d3a7055b155c0727d4316e06c7f711dc8e50db3d: Status 404 returned error can't find the container with id 203da5c55c02bccda8add902d3a7055b155c0727d4316e06c7f711dc8e50db3d Jun 15 02:33:09.955609 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.955567 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"203da5c55c02bccda8add902d3a7055b155c0727d4316e06c7f711dc8e50db3d"} Jun 15 02:33:09.957698 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.957607 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"ce270597656a148dbeed6188edd95f284699455ad92058acc2b4768e5d075931"} Jun 15 02:33:09.959713 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.959682 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" event={"ID":"befd20b5-9cb7-4c0d-977c-f421817b378e","Type":"ContainerStarted","Data":"e1c1d10f9aef63539b6e5278b7a2a13b194d6c147b5ccb097b866f6ed9fd76c6"} Jun 15 02:33:09.961334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.961270 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cr2pz" event={"ID":"a839b417-c759-419c-ad89-091ee9de286f","Type":"ContainerStarted","Data":"8a0c33f5124573235578f3c4680a85430b971ccd99cb85a1c7da50263b755975"} Jun 15 02:33:09.963231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.963181 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" event={"ID":"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba","Type":"ContainerStarted","Data":"0fc330670c577d7d0572878a0d3015fd3ec33538e0cd7cf955beee232d161ab4"} Jun 15 02:33:09.965094 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.965065 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-9fs7c" event={"ID":"e90f45c7-9e12-4579-9e72-98c96463e2c9","Type":"ContainerStarted","Data":"7c3043ae9906c0c7f94ef77e4d6fc91cfed60fca7786741177bb3df4f267ca05"} Jun 15 02:33:09.965696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.965641 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:33:09.977637 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.977613 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-9fs7c" Jun 15 02:33:09.983214 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:09.983162 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-9fs7c" podStartSLOduration=1.217968388 podStartE2EDuration="20.983149069s" totalImagesPullingTime="19.765180681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:09.981007676 +0000 UTC m=+280.366930287" watchObservedRunningTime="2026-06-15 02:33:09.983149069 +0000 UTC m=+280.369071703" Jun 15 02:33:10.984143 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:10.984075 2559 generic.go:356] "Generic (PLEG): container finished" podID="a839b417-c759-419c-ad89-091ee9de286f" containerID="ecc802fb267e2acb0a9c232fe38c7ade8778a30b31039bebf8b315da3925e6c7" exitCode=0 Jun 15 02:33:10.986978 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:10.985272 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cr2pz" event={"ID":"a839b417-c759-419c-ad89-091ee9de286f","Type":"ContainerDied","Data":"ecc802fb267e2acb0a9c232fe38c7ade8778a30b31039bebf8b315da3925e6c7"} Jun 15 02:33:11.559268 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:33:11.559218 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bh7cd" podUID="707efa2d-6065-4258-98f2-1807dd389882" Jun 15 02:33:11.559455 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:33:11.559227 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" Jun 15 02:33:11.988577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:11.988541 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:33:11.988577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:11.988540 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bh7cd" Jun 15 02:33:13.362175 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:13.362142 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:13.462246 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:13.462208 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:14.512561 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.511936 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:33:14.512561 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.512083 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:33:14.514905 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.514879 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/707efa2d-6065-4258-98f2-1807dd389882-metrics-tls\") pod \"dns-default-bh7cd\" (UID: \"707efa2d-6065-4258-98f2-1807dd389882\") " pod="openshift-dns/dns-default-bh7cd" Jun 15 02:33:14.515951 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.515904 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"image-registry-5dc4bf4b5-t8kwx\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:33:14.692513 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.692475 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8fqxc\"" Jun 15 02:33:14.693764 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.693735 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vrtgk\"" Jun 15 02:33:14.700097 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.700064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bh7cd" Jun 15 02:33:14.700200 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.700164 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:33:14.907120 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.907047 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bh7cd"] Jun 15 02:33:14.918378 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:33:14.918343 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707efa2d_6065_4258_98f2_1807dd389882.slice/crio-2c9c22e779dbe1d021a0fdd6ead481b9809888d70bc8bb3233c8ac2f4867387a WatchSource:0}: Error finding container 2c9c22e779dbe1d021a0fdd6ead481b9809888d70bc8bb3233c8ac2f4867387a: Status 404 returned error can't find the container with id 2c9c22e779dbe1d021a0fdd6ead481b9809888d70bc8bb3233c8ac2f4867387a Jun 15 02:33:14.938337 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:14.938236 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5dc4bf4b5-t8kwx"] Jun 15 02:33:14.942593 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:33:14.942564 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podded3fd27_5ff8_4b78_881f_731c0d3e10dd.slice/crio-102d5ba27c4933f5e49416951cb46858bf9fafb02dbb38b71da50cb292f67c39 WatchSource:0}: Error finding container 102d5ba27c4933f5e49416951cb46858bf9fafb02dbb38b71da50cb292f67c39: Status 404 returned error can't find the container with id 102d5ba27c4933f5e49416951cb46858bf9fafb02dbb38b71da50cb292f67c39 Jun 15 02:33:15.007891 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.007808 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bh7cd" event={"ID":"707efa2d-6065-4258-98f2-1807dd389882","Type":"ContainerStarted","Data":"2c9c22e779dbe1d021a0fdd6ead481b9809888d70bc8bb3233c8ac2f4867387a"} Jun 15 02:33:15.013773 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.012599 2559 generic.go:356] "Generic (PLEG): container finished" podID="88982110-7082-4c09-bf5e-e85e4e779638" containerID="0a2dafd4ffa07e6f5889b69489faa669844542f00cc7ef521b0802674c90be81" exitCode=0 Jun 15 02:33:15.013773 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.012681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerDied","Data":"0a2dafd4ffa07e6f5889b69489faa669844542f00cc7ef521b0802674c90be81"} Jun 15 02:33:15.019045 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.019019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"2b28410dc6da59f3ceee7f9bb3b8dc8213a2f32ab8047aec1dbfd76c0b9e4b97"} Jun 15 02:33:15.019220 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.019202 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"1fd2a592a5d66aa426fb9b59b1b7fe3f1cefa4a30afbda2a0822ef12b08ceba7"} Jun 15 02:33:15.019356 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.019339 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"60721f001937a9ba4f9ef7514d56854fc281b0668aed7b037f6453a7f5138828"} Jun 15 02:33:15.021514 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.021152 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" event={"ID":"ded3fd27-5ff8-4b78-881f-731c0d3e10dd","Type":"ContainerStarted","Data":"102d5ba27c4933f5e49416951cb46858bf9fafb02dbb38b71da50cb292f67c39"} Jun 15 02:33:15.024883 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.024303 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" event={"ID":"befd20b5-9cb7-4c0d-977c-f421817b378e","Type":"ContainerStarted","Data":"85aa6280572bed3be1cfaff4cab510fdcd452089fdda7030240f5ab0b86ef1d1"} Jun 15 02:33:15.024883 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.024359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" event={"ID":"befd20b5-9cb7-4c0d-977c-f421817b378e","Type":"ContainerStarted","Data":"1db593aa23b343a5ce8d43777fa16a1f184fd86599d7bfb6f91031d3be837c00"} Jun 15 02:33:15.024883 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.024392 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" event={"ID":"befd20b5-9cb7-4c0d-977c-f421817b378e","Type":"ContainerStarted","Data":"b0111633cb9844121638e2117db9b910e45c2ee772ea31b94c97fc8fdc9210c5"} Jun 15 02:33:15.028449 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.028373 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cr2pz" event={"ID":"a839b417-c759-419c-ad89-091ee9de286f","Type":"ContainerStarted","Data":"f1642c063f27de9b59bc35d988f24a4187929a456f10b34f8e8f154fe4df5767"} Jun 15 02:33:15.028449 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.028418 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cr2pz" event={"ID":"a839b417-c759-419c-ad89-091ee9de286f","Type":"ContainerStarted","Data":"7e5d4134a519a6fab3eaa06841291474e06ec7a460fc52ef670098d009df398f"} Jun 15 02:33:15.031160 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.031133 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" event={"ID":"80ad6dc9-b33c-4f59-bbf1-201eb318f9ba","Type":"ContainerStarted","Data":"0e941bb85f125d79dbe3bf7d8196ba453c12e84815b0eae3bc51759481b71869"} Jun 15 02:33:15.033126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.033091 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:15.038760 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.038737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" Jun 15 02:33:15.061944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.061892 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cr2pz" podStartSLOduration=12.963633632 podStartE2EDuration="14.061864589s" totalImagesPullingTime="1.002025192s" totalInitContainerRuntime="96.205765ms" isStatefulPod=true podCreationTimestamp="2026-06-15 02:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:15.061485841 +0000 UTC m=+285.447408451" watchObservedRunningTime="2026-06-15 02:33:15.061864589 +0000 UTC m=+285.447787202" Jun 15 02:33:15.081012 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.080945 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h5vcf" podStartSLOduration=4.50445664 podStartE2EDuration="9.080927524s" totalImagesPullingTime="4.576470884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:33:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:15.079958627 +0000 UTC m=+285.465881237" watchObservedRunningTime="2026-06-15 02:33:15.080927524 +0000 UTC m=+285.466850114" Jun 15 02:33:15.102139 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:15.102086 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-8bvbg" podStartSLOduration=9.749178989 podStartE2EDuration="14.10206669s" totalImagesPullingTime="4.352887701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:15.100401126 +0000 UTC m=+285.486323736" watchObservedRunningTime="2026-06-15 02:33:15.10206669 +0000 UTC m=+285.487989302" Jun 15 02:33:16.042744 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:16.042709 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"a43c9e093b8211e15e49782fa5aa8b20e5b2f0e29e65e7587a12367d18fafe97"} Jun 15 02:33:16.043342 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:16.042792 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"b288afc137be159c41cec1243a2c11b396a363602843165a0ee265fd32e37583"} Jun 15 02:33:16.043342 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:16.042836 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" event={"ID":"a5f4d5b5-e850-482d-8f58-da6b4dec9905","Type":"ContainerStarted","Data":"e02e5191929eef7b78124c77e10946f057e13223ab26908104c70992aacb57f6"} Jun 15 02:33:16.049756 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:16.048177 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" event={"ID":"ded3fd27-5ff8-4b78-881f-731c0d3e10dd","Type":"ContainerStarted","Data":"1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3"} Jun 15 02:33:16.049756 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:16.049720 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:33:16.073587 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:16.073534 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" podStartSLOduration=289.073515031 podStartE2EDuration="4m49.073515031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:28:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:16.072163897 +0000 UTC m=+286.458086578" watchObservedRunningTime="2026-06-15 02:33:16.073515031 +0000 UTC m=+286.459437643" Jun 15 02:33:17.053727 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:17.053642 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:17.081024 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:17.079828 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" podStartSLOduration=7.592346532 podStartE2EDuration="13.07980646s" totalImagesPullingTime="5.487459928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:33:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:17.077389096 +0000 UTC m=+287.463311707" watchObservedRunningTime="2026-06-15 02:33:17.07980646 +0000 UTC m=+287.465729071" Jun 15 02:33:17.191830 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:17.191781 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:17.265144 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:17.264978 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:19.088967 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:19.088811 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f987994b9-zp9lb" Jun 15 02:33:20.074305 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.074273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bh7cd" event={"ID":"707efa2d-6065-4258-98f2-1807dd389882","Type":"ContainerStarted","Data":"07a4dd26c9bccbfb767ab8af06ce8e0cb677b23ea8b9ee013b8e6574142f7e7d"} Jun 15 02:33:20.074417 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.074334 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bh7cd" Jun 15 02:33:20.074417 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.074360 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bh7cd" event={"ID":"707efa2d-6065-4258-98f2-1807dd389882","Type":"ContainerStarted","Data":"f435593aaa2fe43b4d32db183c8474f68afa2c9168ee076090fc21e3083ef103"} Jun 15 02:33:20.077316 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.077273 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"e3074805e09ef2b50f29ea81c7b08caab76a4d16468965d5fe25d8a1a990d505"} Jun 15 02:33:20.077426 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.077345 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"2496cf7a7d9e1f50e009e35af30122943661b5fe6aa0f6338ce27681470d890c"} Jun 15 02:33:20.077426 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.077387 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"439c12ce8c81aa6707b747b62d96d4722c43d6fa1322a943780286affd811a05"} Jun 15 02:33:20.077520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.077425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"b1a4366d95104ddd3189108dbdee2d4588a5962f873fb5aa81b0e848ec79d256"} Jun 15 02:33:20.092522 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:20.092478 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bh7cd" podStartSLOduration=251.815974063 podStartE2EDuration="4m16.092461381s" totalImagesPullingTime="4.276487318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:29:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:20.091955208 +0000 UTC m=+290.477877819" watchObservedRunningTime="2026-06-15 02:33:20.092461381 +0000 UTC m=+290.478383992" Jun 15 02:33:21.087608 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:21.087569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"21bd695b74bfb18346ad3048dd4fc523189b22f9373d33e9ce05f9d46dbd870e"} Jun 15 02:33:21.087774 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:21.087662 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88982110-7082-4c09-bf5e-e85e4e779638","Type":"ContainerStarted","Data":"d3336ebc1c9a7b55fbb11c1fc777db63ab5082e3b65ada2bd19bf628e4741a9d"} Jun 15 02:33:21.103291 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:21.103255 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:21.119358 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:21.119309 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.239942798 podStartE2EDuration="14.119289827s" totalImagesPullingTime="8.843939308s" totalInitContainerRuntime="35.407721ms" isStatefulPod=false podCreationTimestamp="2026-06-15 02:33:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:33:21.115926347 +0000 UTC m=+291.501848957" watchObservedRunningTime="2026-06-15 02:33:21.119289827 +0000 UTC m=+291.505212693" Jun 15 02:33:21.152391 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:21.152359 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:22.875880 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:22.875839 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:22.927345 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:22.927299 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:23.137303 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:23.137227 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:33:30.035840 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:30.035812 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:33:30.037404 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:30.037380 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:33:30.043626 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:30.043605 2559 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 02:33:30.090391 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:30.090245 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bh7cd" Jun 15 02:33:31.419249 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:31.419219 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:32.130692 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:32.130617 2559 generic.go:356] "Generic (PLEG): container finished" podID="a3faa307-10ac-46cd-926e-213c889b97fe" containerID="632700c31978abbce6e4af63f345a72365a51d467dc8ade2965fae33bdfadf37" exitCode=0 Jun 15 02:33:32.130824 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:32.130692 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" event={"ID":"a3faa307-10ac-46cd-926e-213c889b97fe","Type":"ContainerDied","Data":"632700c31978abbce6e4af63f345a72365a51d467dc8ade2965fae33bdfadf37"} Jun 15 02:33:32.131058 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:32.131036 2559 scope.go:117] "RemoveContainer" containerID="632700c31978abbce6e4af63f345a72365a51d467dc8ade2965fae33bdfadf37" Jun 15 02:33:32.448824 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:32.448789 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:32.498474 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:32.498441 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:33.136646 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:33.136612 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-xkcbj" event={"ID":"a3faa307-10ac-46cd-926e-213c889b97fe","Type":"ContainerStarted","Data":"79158a231825a55d7c1e606996652b45e138ac024de0deb1aded5a5a2206bc3f"} Jun 15 02:33:34.704413 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:34.704375 2559 patch_prober.go:28] interesting pod/image-registry-5dc4bf4b5-t8kwx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 15 02:33:34.704758 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:34.704434 2559 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 02:33:36.607216 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:36.607180 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:36.656692 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:36.656663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:37.110685 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:37.110639 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:37.210207 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:37.210175 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:38.068467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:38.068438 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:33:38.226593 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:38.226561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:38.326717 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:38.326632 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:38.986971 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:38.986931 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:39.087363 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:39.087311 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:39.605520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:39.605491 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dc4bf4b5-t8kwx"] Jun 15 02:33:39.676467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:39.676439 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:39.728230 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:39.728201 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:40.225758 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:40.225722 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:40.273613 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:40.273584 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:45.618185 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:45.618152 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:45.718955 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:45.718920 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:45.818952 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:45.818918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:47.197780 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:47.197752 2559 generic.go:356] "Generic (PLEG): container finished" podID="71163f29-58d5-4390-be0d-75104fdd2d79" containerID="f71b962140af9a4937d152a43aa3d3c423099a460d7459c6ba23c47f67cc5ec9" exitCode=0 Jun 15 02:33:47.198135 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:47.197830 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" event={"ID":"71163f29-58d5-4390-be0d-75104fdd2d79","Type":"ContainerDied","Data":"f71b962140af9a4937d152a43aa3d3c423099a460d7459c6ba23c47f67cc5ec9"} Jun 15 02:33:47.198196 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:47.198182 2559 scope.go:117] "RemoveContainer" containerID="f71b962140af9a4937d152a43aa3d3c423099a460d7459c6ba23c47f67cc5ec9" Jun 15 02:33:48.153900 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.153843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:48.176800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.176771 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65dd75fbbd-wbt2h_9631d33a-8f79-4f1e-b1f2-80a9137ab308/router/0.log" Jun 15 02:33:48.182489 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.182466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dz8b9_cc301e02-5d66-4ee7-8e02-9a3732ac2bab/serve-healthcheck-canary/0.log" Jun 15 02:33:48.203665 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.203638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-tlmrs" event={"ID":"71163f29-58d5-4390-be0d-75104fdd2d79","Type":"ContainerStarted","Data":"b8b1cb9242385b64421f99e0aed88ceb8062792264dcd937c5ed823f28632b41"} Jun 15 02:33:48.224368 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.224327 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:48.670132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.670089 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-rh2ct_bc3b2ba8-3fec-4eee-8108-331f94bc7b03/cluster-samples-operator/0.log" Jun 15 02:33:48.869470 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:48.869438 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-9547488fd-rh2ct_bc3b2ba8-3fec-4eee-8108-331f94bc7b03/cluster-samples-operator-watch/0.log" Jun 15 02:33:54.228763 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:54.228728 2559 generic.go:356] "Generic (PLEG): container finished" podID="1d49b714-3287-43aa-b880-61b5bea8deeb" containerID="e8d3d0066f7534eb9d9f8e05153e4fa238b55aec4afa052e37b19ea47aa33bb2" exitCode=0 Jun 15 02:33:54.229327 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:54.228810 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" event={"ID":"1d49b714-3287-43aa-b880-61b5bea8deeb","Type":"ContainerDied","Data":"e8d3d0066f7534eb9d9f8e05153e4fa238b55aec4afa052e37b19ea47aa33bb2"} Jun 15 02:33:54.229327 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:54.229221 2559 scope.go:117] "RemoveContainer" containerID="e8d3d0066f7534eb9d9f8e05153e4fa238b55aec4afa052e37b19ea47aa33bb2" Jun 15 02:33:55.233931 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:55.233900 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-9nkfl" event={"ID":"1d49b714-3287-43aa-b880-61b5bea8deeb","Type":"ContainerStarted","Data":"7c8fafb28d1a5f89e3b49bf121423e36d891c5d9b9af5191be57485ff106cf80"} Jun 15 02:33:56.471908 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:56.471871 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:33:56.541758 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:33:56.541720 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:00.750603 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:00.750574 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:00.798610 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:00.798568 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:04.625960 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.625909 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" containerName="registry" containerID="cri-o://1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3" gracePeriod=30 Jun 15 02:34:04.869346 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.869322 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:34:04.946056 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946029 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-ca-trust-extracted\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946078 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-installation-pull-secrets\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946165 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-trusted-ca\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946189 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk242\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-kube-api-access-zk242\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946215 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-certificates\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946443 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946249 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946443 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946281 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-image-registry-private-configuration\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.946443 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.946323 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-bound-sa-token\") pod \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\" (UID: \"ded3fd27-5ff8-4b78-881f-731c0d3e10dd\") " Jun 15 02:34:04.947117 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.947047 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:34:04.947477 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.947424 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:34:04.948972 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.948927 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:34:04.948972 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.948946 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:34:04.949420 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.949394 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:34:04.949728 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.949681 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:34:04.949728 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.949721 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-kube-api-access-zk242" (OuterVolumeSpecName: "kube-api-access-zk242") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "kube-api-access-zk242". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:34:04.955257 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:04.955235 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ded3fd27-5ff8-4b78-881f-731c0d3e10dd" (UID: "ded3fd27-5ff8-4b78-881f-731c0d3e10dd"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:34:05.047630 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047602 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-trusted-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047630 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047625 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk242\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-kube-api-access-zk242\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047630 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047635 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-certificates\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047645 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-registry-tls\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047654 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-image-registry-private-configuration\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047663 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-bound-sa-token\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047671 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-ca-trust-extracted\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.047807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.047679 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ded3fd27-5ff8-4b78-881f-731c0d3e10dd-installation-pull-secrets\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:34:05.287225 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.287149 2559 generic.go:356] "Generic (PLEG): container finished" podID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" containerID="1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3" exitCode=0 Jun 15 02:34:05.287225 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.287192 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" Jun 15 02:34:05.287225 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.287217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" event={"ID":"ded3fd27-5ff8-4b78-881f-731c0d3e10dd","Type":"ContainerDied","Data":"1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3"} Jun 15 02:34:05.287448 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.287253 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5dc4bf4b5-t8kwx" event={"ID":"ded3fd27-5ff8-4b78-881f-731c0d3e10dd","Type":"ContainerDied","Data":"102d5ba27c4933f5e49416951cb46858bf9fafb02dbb38b71da50cb292f67c39"} Jun 15 02:34:05.287448 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.287281 2559 scope.go:117] "RemoveContainer" containerID="1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3" Jun 15 02:34:05.296230 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.296210 2559 scope.go:117] "RemoveContainer" containerID="1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3" Jun 15 02:34:05.296472 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:34:05.296453 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3\": container with ID starting with 1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3 not found: ID does not exist" containerID="1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3" Jun 15 02:34:05.296520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.296480 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3"} err="failed to get container status \"1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3\": rpc error: code = NotFound desc = could not find container \"1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3\": container with ID starting with 1dea072d2b399731b03c913f3849f95dd8f3b435c5e89af00abfe77fb61729d3 not found: ID does not exist" Jun 15 02:34:05.308434 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.308410 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5dc4bf4b5-t8kwx"] Jun 15 02:34:05.311825 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:05.311804 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5dc4bf4b5-t8kwx"] Jun 15 02:34:06.085127 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:06.085094 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" path="/var/lib/kubelet/pods/ded3fd27-5ff8-4b78-881f-731c0d3e10dd/volumes" Jun 15 02:34:06.965360 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:06.965326 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:07.063651 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:07.063619 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:07.115357 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:07.115321 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:08.137493 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:08.137459 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:34:08.154071 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:08.154047 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:34:08.315798 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:08.315772 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:34:09.328942 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:09.328906 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:09.379878 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:09.379843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:15.747678 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:15.747636 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:15.847696 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:15.847661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:17.409636 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:17.409549 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:17.462217 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:17.462190 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:20.799709 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:20.799667 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:21.101703 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:21.101618 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:29.517291 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:29.517260 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:29.563900 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:29.563871 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:30.754656 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:30.754627 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:30.855235 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:30.855206 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:36.016451 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:36.016410 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:36.070422 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:36.070385 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:38.019414 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:38.019380 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:38.072969 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:38.072936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:38.619007 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:38.618959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:38.666756 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:38.666725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:41.369496 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:41.369467 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:41.470736 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:41.470711 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:45.757091 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:45.757059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:45.857747 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:45.857710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:45.906220 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:45.906195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:48.557508 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:48.557476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:48.658402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:48.658371 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:34:48.706688 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:34:48.706662 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:01.524261 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:01.524228 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:01.626412 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:01.626345 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:03.880732 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:03.880692 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:03.930151 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:03.930124 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:18.277131 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:18.277097 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:28.102116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:28.102077 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:28.890356 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:28.890315 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:31.712781 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:31.712744 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:31.761481 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:31.761431 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:32.636876 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:32.636837 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:32.737878 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:32.737845 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:33.393742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:33.393707 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:33.485267 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:33.485241 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:35.933733 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:35.933700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:36.534683 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:36.534650 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:38.499820 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:38.499785 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:38.551023 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:38.550974 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:40.703250 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:40.703213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:40.809979 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:40.809949 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:44.542159 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:44.542127 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:49.907932 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:49.907847 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:50.012709 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:50.012655 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:51.939727 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.939689 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx"] Jun 15 02:35:51.940118 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.940083 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" containerName="registry" Jun 15 02:35:51.940118 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.940095 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" containerName="registry" Jun 15 02:35:51.940192 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.940172 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded3fd27-5ff8-4b78-881f-731c0d3e10dd" containerName="registry" Jun 15 02:35:51.942069 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.942052 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:51.944785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.944758 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-cbg96\"" Jun 15 02:35:51.944785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.944780 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:35:51.944971 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.944784 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 02:35:51.950387 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.950363 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx"] Jun 15 02:35:51.995109 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.995083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hpf9\" (UniqueName: \"kubernetes.io/projected/d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76-kube-api-access-2hpf9\") pod \"openshift-lws-operator-fd8ccff4c-szqlx\" (UID: \"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:51.995271 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:51.995138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76-tmp\") pod \"openshift-lws-operator-fd8ccff4c-szqlx\" (UID: \"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:52.096181 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.096151 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hpf9\" (UniqueName: \"kubernetes.io/projected/d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76-kube-api-access-2hpf9\") pod \"openshift-lws-operator-fd8ccff4c-szqlx\" (UID: \"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:52.096368 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.096206 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76-tmp\") pod \"openshift-lws-operator-fd8ccff4c-szqlx\" (UID: \"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:52.096517 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.096494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76-tmp\") pod \"openshift-lws-operator-fd8ccff4c-szqlx\" (UID: \"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:52.111221 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.111200 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hpf9\" (UniqueName: \"kubernetes.io/projected/d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76-kube-api-access-2hpf9\") pod \"openshift-lws-operator-fd8ccff4c-szqlx\" (UID: \"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:52.260032 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.259973 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" Jun 15 02:35:52.389790 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.389766 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx"] Jun 15 02:35:52.392253 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:35:52.392227 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4fb802b_c49c_45d6_a36f_fa4f0b8e1d76.slice/crio-b64b09a76a3cb2b568ce503bc0287304c458876965b0ffb9bcedf49da8bd1457 WatchSource:0}: Error finding container b64b09a76a3cb2b568ce503bc0287304c458876965b0ffb9bcedf49da8bd1457: Status 404 returned error can't find the container with id b64b09a76a3cb2b568ce503bc0287304c458876965b0ffb9bcedf49da8bd1457 Jun 15 02:35:52.394165 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.394150 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:35:52.723388 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:52.723353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" event={"ID":"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76","Type":"ContainerStarted","Data":"b64b09a76a3cb2b568ce503bc0287304c458876965b0ffb9bcedf49da8bd1457"} Jun 15 02:35:55.738581 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:55.738546 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" event={"ID":"d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76","Type":"ContainerStarted","Data":"b04c0602330b73285aaf29e03176fa56255db9c293b69d6e4ccc3321a8cc58dd"} Jun 15 02:35:55.755053 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:55.755005 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-szqlx" podStartSLOduration=2.14458039 podStartE2EDuration="4.754973056s" totalImagesPullingTime="2.610392666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:35:55.753841698 +0000 UTC m=+446.139764310" watchObservedRunningTime="2026-06-15 02:35:55.754973056 +0000 UTC m=+446.140895675" Jun 15 02:35:56.452650 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:56.452610 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:56.552550 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:56.552521 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:35:58.412415 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:35:58.412382 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:03.333431 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:03.333403 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:10.729536 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.729501 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:10.825598 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.825561 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:10.827027 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.827007 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj"] Jun 15 02:36:10.829224 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.829210 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:10.833058 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.833037 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 02:36:10.834190 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.834173 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 02:36:10.834301 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.834245 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 02:36:10.834553 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.834533 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-md8st\"" Jun 15 02:36:10.848132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.848110 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj"] Jun 15 02:36:10.965336 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.965289 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx46s\" (UniqueName: \"kubernetes.io/projected/8dd227dc-d718-487e-8bbb-164f6017e74f-kube-api-access-cx46s\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:10.965547 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.965360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dd227dc-d718-487e-8bbb-164f6017e74f-manager-config\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:10.965547 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.965393 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dd227dc-d718-487e-8bbb-164f6017e74f-cert\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:10.965547 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:10.965411 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd227dc-d718-487e-8bbb-164f6017e74f-metrics-cert\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.066004 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.065897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx46s\" (UniqueName: \"kubernetes.io/projected/8dd227dc-d718-487e-8bbb-164f6017e74f-kube-api-access-cx46s\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.066004 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.065975 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dd227dc-d718-487e-8bbb-164f6017e74f-manager-config\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.066167 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.066038 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dd227dc-d718-487e-8bbb-164f6017e74f-cert\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.066167 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.066065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd227dc-d718-487e-8bbb-164f6017e74f-metrics-cert\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.066802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.066693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8dd227dc-d718-487e-8bbb-164f6017e74f-manager-config\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.068538 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.068516 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8dd227dc-d718-487e-8bbb-164f6017e74f-cert\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.068638 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.068598 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8dd227dc-d718-487e-8bbb-164f6017e74f-metrics-cert\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.074678 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.074659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx46s\" (UniqueName: \"kubernetes.io/projected/8dd227dc-d718-487e-8bbb-164f6017e74f-kube-api-access-cx46s\") pod \"lws-controller-manager-7d59cb4d96-hlznj\" (UID: \"8dd227dc-d718-487e-8bbb-164f6017e74f\") " pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.139407 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.139377 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:11.301623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.301582 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj"] Jun 15 02:36:11.307254 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:36:11.307195 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd227dc_d718_487e_8bbb_164f6017e74f.slice/crio-a0d8b7bc5375361aac2b97f78bdb3b6a366205e7a16de7162cd7289517cd5d31 WatchSource:0}: Error finding container a0d8b7bc5375361aac2b97f78bdb3b6a366205e7a16de7162cd7289517cd5d31: Status 404 returned error can't find the container with id a0d8b7bc5375361aac2b97f78bdb3b6a366205e7a16de7162cd7289517cd5d31 Jun 15 02:36:11.336653 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.336592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:11.588593 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.588511 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:11.690383 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.690351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:11.734334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.734298 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg"] Jun 15 02:36:11.737364 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.737343 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.740912 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.740890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 02:36:11.741132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.741117 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 02:36:11.741222 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.741203 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-f8fh8\"" Jun 15 02:36:11.741269 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.741261 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 02:36:11.741824 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.741799 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 02:36:11.756021 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.755979 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg"] Jun 15 02:36:11.803146 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.803114 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" event={"ID":"8dd227dc-d718-487e-8bbb-164f6017e74f","Type":"ContainerStarted","Data":"a0d8b7bc5375361aac2b97f78bdb3b6a366205e7a16de7162cd7289517cd5d31"} Jun 15 02:36:11.872351 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.872269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d89bbf9-b149-441d-b968-8f6e17151249-webhook-cert\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.872351 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.872325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d89bbf9-b149-441d-b968-8f6e17151249-manifests\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.872533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.872386 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzwnt\" (UniqueName: \"kubernetes.io/projected/5d89bbf9-b149-441d-b968-8f6e17151249-kube-api-access-bzwnt\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.872533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.872420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d89bbf9-b149-441d-b968-8f6e17151249-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.872533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.872452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d89bbf9-b149-441d-b968-8f6e17151249-tmp\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.937468 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.937430 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:11.973302 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.973266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d89bbf9-b149-441d-b968-8f6e17151249-manifests\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.973438 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.973310 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzwnt\" (UniqueName: \"kubernetes.io/projected/5d89bbf9-b149-441d-b968-8f6e17151249-kube-api-access-bzwnt\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.973438 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.973429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d89bbf9-b149-441d-b968-8f6e17151249-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.973564 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.973474 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d89bbf9-b149-441d-b968-8f6e17151249-tmp\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.973564 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.973512 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d89bbf9-b149-441d-b968-8f6e17151249-webhook-cert\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.973689 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.973622 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5d89bbf9-b149-441d-b968-8f6e17151249-manifests\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.975938 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.975919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d89bbf9-b149-441d-b968-8f6e17151249-tmp\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.976061 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.976034 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5d89bbf9-b149-441d-b968-8f6e17151249-webhook-cert\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.976142 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.976125 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5d89bbf9-b149-441d-b968-8f6e17151249-apiservice-cert\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:11.982183 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:11.982164 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzwnt\" (UniqueName: \"kubernetes.io/projected/5d89bbf9-b149-441d-b968-8f6e17151249-kube-api-access-bzwnt\") pod \"opendatahub-operator-controller-manager-785bc74785-zxpcg\" (UID: \"5d89bbf9-b149-441d-b968-8f6e17151249\") " pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:12.034785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.034755 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:12.047844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.047819 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:12.136219 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.136190 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:12.190507 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.190477 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg"] Jun 15 02:36:12.192929 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:36:12.192898 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d89bbf9_b149_441d_b968_8f6e17151249.slice/crio-81cb3e17a8c822ade6b71c200fe01fe0a5323d9caef6b18c79f03c48fd88a0b7 WatchSource:0}: Error finding container 81cb3e17a8c822ade6b71c200fe01fe0a5323d9caef6b18c79f03c48fd88a0b7: Status 404 returned error can't find the container with id 81cb3e17a8c822ade6b71c200fe01fe0a5323d9caef6b18c79f03c48fd88a0b7 Jun 15 02:36:12.232512 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.232479 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:12.342849 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.342812 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:12.452523 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.452484 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:12.813819 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:12.813738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" event={"ID":"5d89bbf9-b149-441d-b968-8f6e17151249","Type":"ContainerStarted","Data":"81cb3e17a8c822ade6b71c200fe01fe0a5323d9caef6b18c79f03c48fd88a0b7"} Jun 15 02:36:13.821861 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:13.821823 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" event={"ID":"8dd227dc-d718-487e-8bbb-164f6017e74f","Type":"ContainerStarted","Data":"49d2bbb82080ba09fbd3e3978c80de3ce88b8bba8f8d122dd3f0dff117639763"} Jun 15 02:36:13.822379 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:13.821937 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:13.846737 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:13.846681 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" podStartSLOduration=1.8598294690000001 podStartE2EDuration="3.84666134s" totalImagesPullingTime="1.986831871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:36:13.846079747 +0000 UTC m=+464.232002361" watchObservedRunningTime="2026-06-15 02:36:13.84666134 +0000 UTC m=+464.232583951" Jun 15 02:36:15.834263 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:15.834226 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" event={"ID":"5d89bbf9-b149-441d-b968-8f6e17151249","Type":"ContainerStarted","Data":"588f5695ae8971dfd8209a7dc73bf42573f12deff8d07c7ca4cf0c65d4b8250b"} Jun 15 02:36:16.839850 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:16.839814 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d89bbf9-b149-441d-b968-8f6e17151249" containerID="588f5695ae8971dfd8209a7dc73bf42573f12deff8d07c7ca4cf0c65d4b8250b" exitCode=0 Jun 15 02:36:16.840321 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:16.839897 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" event={"ID":"5d89bbf9-b149-441d-b968-8f6e17151249","Type":"ContainerDied","Data":"588f5695ae8971dfd8209a7dc73bf42573f12deff8d07c7ca4cf0c65d4b8250b"} Jun 15 02:36:17.846459 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:17.846422 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" event={"ID":"5d89bbf9-b149-441d-b968-8f6e17151249","Type":"ContainerStarted","Data":"32ab8f2928be721e136a914707e6f0538c7c33c423a83bd292aa231117edfa17"} Jun 15 02:36:17.846872 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:17.846527 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:17.870804 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:17.870761 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" podStartSLOduration=2.6710096979999998 podStartE2EDuration="6.870747278s" totalImagesPullingTime="3.207070971s" totalInitContainerRuntime="992.666609ms" isStatefulPod=false podCreationTimestamp="2026-06-15 02:36:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:36:17.868697488 +0000 UTC m=+468.254620109" watchObservedRunningTime="2026-06-15 02:36:17.870747278 +0000 UTC m=+468.256669889" Jun 15 02:36:22.249509 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:22.249476 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:22.347326 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:22.347291 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:24.829157 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:24.829126 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7d59cb4d96-hlznj" Jun 15 02:36:28.853569 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:28.853538 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-785bc74785-zxpcg" Jun 15 02:36:30.494677 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:30.494612 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:30.597192 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:30.597151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:33.437040 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:33.437002 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:33.537064 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:33.537022 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:33.706386 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:33.706284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:33.803742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:33.803695 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:33.903242 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:33.903211 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:34.005436 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:34.005310 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:34.102121 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:34.102086 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:34.167056 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:34.167024 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:34.268426 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:34.268341 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:43.587687 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:43.587647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:43.663927 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:43.663892 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:43.747671 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:43.747634 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:43.915161 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:43.915116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:44.928662 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:44.928621 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:45.040745 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:45.040714 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:48.170544 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:48.170511 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:48.285649 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:48.285596 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:49.323826 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:49.323794 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:49.430966 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:49.430935 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:50.340660 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:50.340624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:50.447195 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:50.447147 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:36:52.163674 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:36:52.163638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:02.347463 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:02.347415 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:02.448156 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:02.448116 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:03.766887 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.766843 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:03.834280 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.834242 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:03.897494 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.897460 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-558999765c-5qcsn"] Jun 15 02:37:03.900142 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.900121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:03.903922 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.903899 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 15 02:37:03.904070 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.903939 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zm9kg\"" Jun 15 02:37:03.914357 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.914331 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-558999765c-5qcsn"] Jun 15 02:37:03.955446 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:03.955425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:04.022507 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.022441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgwlg\" (UniqueName: \"kubernetes.io/projected/793aeaff-3b63-4311-acf3-614a5c2905d4-kube-api-access-qgwlg\") pod \"dashboard-redirect-558999765c-5qcsn\" (UID: \"793aeaff-3b63-4311-acf3-614a5c2905d4\") " pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.022620 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.022509 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/793aeaff-3b63-4311-acf3-614a5c2905d4-redirect-config\") pod \"dashboard-redirect-558999765c-5qcsn\" (UID: \"793aeaff-3b63-4311-acf3-614a5c2905d4\") " pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.122957 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.122923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgwlg\" (UniqueName: \"kubernetes.io/projected/793aeaff-3b63-4311-acf3-614a5c2905d4-kube-api-access-qgwlg\") pod \"dashboard-redirect-558999765c-5qcsn\" (UID: \"793aeaff-3b63-4311-acf3-614a5c2905d4\") " pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.123133 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.122978 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/793aeaff-3b63-4311-acf3-614a5c2905d4-redirect-config\") pod \"dashboard-redirect-558999765c-5qcsn\" (UID: \"793aeaff-3b63-4311-acf3-614a5c2905d4\") " pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.123637 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.123618 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/793aeaff-3b63-4311-acf3-614a5c2905d4-redirect-config\") pod \"dashboard-redirect-558999765c-5qcsn\" (UID: \"793aeaff-3b63-4311-acf3-614a5c2905d4\") " pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.131136 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.131109 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgwlg\" (UniqueName: \"kubernetes.io/projected/793aeaff-3b63-4311-acf3-614a5c2905d4-kube-api-access-qgwlg\") pod \"dashboard-redirect-558999765c-5qcsn\" (UID: \"793aeaff-3b63-4311-acf3-614a5c2905d4\") " pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.212166 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.212142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-558999765c-5qcsn" Jun 15 02:37:04.289835 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.289758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:04.342118 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:04.342093 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-558999765c-5qcsn"] Jun 15 02:37:04.344604 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:37:04.344573 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793aeaff_3b63_4311_acf3_614a5c2905d4.slice/crio-cbfedbe405d91337f971a7ab6ef50687f33fa0129cc781a2fd22438cc649a3e1 WatchSource:0}: Error finding container cbfedbe405d91337f971a7ab6ef50687f33fa0129cc781a2fd22438cc649a3e1: Status 404 returned error can't find the container with id cbfedbe405d91337f971a7ab6ef50687f33fa0129cc781a2fd22438cc649a3e1 Jun 15 02:37:05.064123 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:05.064089 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-558999765c-5qcsn" event={"ID":"793aeaff-3b63-4311-acf3-614a5c2905d4","Type":"ContainerStarted","Data":"cbfedbe405d91337f971a7ab6ef50687f33fa0129cc781a2fd22438cc649a3e1"} Jun 15 02:37:07.074087 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:07.074048 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-558999765c-5qcsn" event={"ID":"793aeaff-3b63-4311-acf3-614a5c2905d4","Type":"ContainerStarted","Data":"bf6ae7599f7748741a6ff817183cbc3ff746c19d1cfd78ba9eefb64f208e01b2"} Jun 15 02:37:07.093623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:07.093567 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-558999765c-5qcsn" podStartSLOduration=2.144887093 podStartE2EDuration="4.093545608s" totalImagesPullingTime="1.948658515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:37:07.090708125 +0000 UTC m=+517.476630736" watchObservedRunningTime="2026-06-15 02:37:07.093545608 +0000 UTC m=+517.479468219" Jun 15 02:37:08.174532 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.174495 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:08.276271 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.276239 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:08.404533 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.404497 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5"] Jun 15 02:37:08.408814 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.408793 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.413124 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.413102 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-8c6zb\"" Jun 15 02:37:08.413952 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.413933 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 15 02:37:08.427698 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.427645 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5"] Jun 15 02:37:08.452240 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.452215 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:08.562017 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.561973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562152 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562026 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562152 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562057 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqqdb\" (UniqueName: \"kubernetes.io/projected/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-kube-api-access-vqqdb\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562152 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562152 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562321 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562196 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562321 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562216 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562321 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562265 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.562444 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.562335 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.622396 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.622368 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:08.663758 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.663867 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.663867 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.663867 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664018 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663876 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664018 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663897 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664018 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqqdb\" (UniqueName: \"kubernetes.io/projected/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-kube-api-access-vqqdb\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664018 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.663946 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664018 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.664015 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664264 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.664216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664516 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.664492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664516 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.664504 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664664 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.664540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.664664 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.664645 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.666598 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.666574 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.666715 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.666699 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.676124 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.676095 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqqdb\" (UniqueName: \"kubernetes.io/projected/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-kube-api-access-vqqdb\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.676272 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.676255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ab1faa1-e59b-4fcd-af82-e05111ab92fb-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hbh5\" (UID: \"4ab1faa1-e59b-4fcd-af82-e05111ab92fb\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.720275 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.720206 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:08.727962 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.727936 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:08.876256 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:08.876224 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5"] Jun 15 02:37:08.877757 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:37:08.877725 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab1faa1_e59b_4fcd_af82_e05111ab92fb.slice/crio-93722c3c11dc8f87e74878f9298da7c33c80fe6b5948cd61cd746e25319838fa WatchSource:0}: Error finding container 93722c3c11dc8f87e74878f9298da7c33c80fe6b5948cd61cd746e25319838fa: Status 404 returned error can't find the container with id 93722c3c11dc8f87e74878f9298da7c33c80fe6b5948cd61cd746e25319838fa Jun 15 02:37:09.083619 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:09.083550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" event={"ID":"4ab1faa1-e59b-4fcd-af82-e05111ab92fb","Type":"ContainerStarted","Data":"93722c3c11dc8f87e74878f9298da7c33c80fe6b5948cd61cd746e25319838fa"} Jun 15 02:37:09.198540 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:09.198505 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:11.644866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:11.644820 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:37:11.645248 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:11.644912 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:37:11.645248 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:11.644961 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:37:12.098837 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:12.098802 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" event={"ID":"4ab1faa1-e59b-4fcd-af82-e05111ab92fb","Type":"ContainerStarted","Data":"4306676e6ee912813fea78822112d4b86678ebb308ee3f3e699f5e5d0e230023"} Jun 15 02:37:12.121153 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:12.121102 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" podStartSLOduration=1.356434578 podStartE2EDuration="4.121086243s" totalImagesPullingTime="2.764651665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:37:12.118931728 +0000 UTC m=+522.504854339" watchObservedRunningTime="2026-06-15 02:37:12.121086243 +0000 UTC m=+522.507008854" Jun 15 02:37:12.720740 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:12.720702 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:12.725430 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:12.725409 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:13.103045 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:13.102946 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:13.103850 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:13.103832 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hbh5" Jun 15 02:37:23.071397 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:23.071313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:24.106250 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:24.106220 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:25.218242 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:25.218209 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:25.272118 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:25.272085 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:32.022579 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.022543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:32.117538 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.117500 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:32.139745 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.139710 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5pwwg"] Jun 15 02:37:32.146520 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.146492 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:32.149260 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.149233 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-ms76z\"" Jun 15 02:37:32.149399 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.149287 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 02:37:32.149399 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.149248 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 02:37:32.154817 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.154790 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5pwwg"] Jun 15 02:37:32.182739 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.182709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:32.267582 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.267540 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcrz6\" (UniqueName: \"kubernetes.io/projected/16d0b0d0-ac16-474c-af7a-de6a22b9a6be-kube-api-access-mcrz6\") pod \"kuadrant-operator-catalog-5pwwg\" (UID: \"16d0b0d0-ac16-474c-af7a-de6a22b9a6be\") " pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:32.368775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.368688 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcrz6\" (UniqueName: \"kubernetes.io/projected/16d0b0d0-ac16-474c-af7a-de6a22b9a6be-kube-api-access-mcrz6\") pod \"kuadrant-operator-catalog-5pwwg\" (UID: \"16d0b0d0-ac16-474c-af7a-de6a22b9a6be\") " pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:32.376910 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.376882 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcrz6\" (UniqueName: \"kubernetes.io/projected/16d0b0d0-ac16-474c-af7a-de6a22b9a6be-kube-api-access-mcrz6\") pod \"kuadrant-operator-catalog-5pwwg\" (UID: \"16d0b0d0-ac16-474c-af7a-de6a22b9a6be\") " pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:32.458857 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.458817 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:32.509472 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.509435 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5pwwg"] Jun 15 02:37:32.596400 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.596314 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5pwwg"] Jun 15 02:37:32.598864 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:37:32.598840 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16d0b0d0_ac16_474c_af7a_de6a22b9a6be.slice/crio-53f4decaba2fe3dbc85cf9f0a867cbc63a916449d06811dc8b5464d965a198ba WatchSource:0}: Error finding container 53f4decaba2fe3dbc85cf9f0a867cbc63a916449d06811dc8b5464d965a198ba: Status 404 returned error can't find the container with id 53f4decaba2fe3dbc85cf9f0a867cbc63a916449d06811dc8b5464d965a198ba Jun 15 02:37:32.718371 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.718339 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-px6z7"] Jun 15 02:37:32.723500 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.723482 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:32.731526 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.731030 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-px6z7"] Jun 15 02:37:32.772734 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.772702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx592\" (UniqueName: \"kubernetes.io/projected/18078039-543c-40f6-bafc-fc957ab328ac-kube-api-access-wx592\") pod \"kuadrant-operator-catalog-px6z7\" (UID: \"18078039-543c-40f6-bafc-fc957ab328ac\") " pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:32.873962 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.873926 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx592\" (UniqueName: \"kubernetes.io/projected/18078039-543c-40f6-bafc-fc957ab328ac-kube-api-access-wx592\") pod \"kuadrant-operator-catalog-px6z7\" (UID: \"18078039-543c-40f6-bafc-fc957ab328ac\") " pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:32.882064 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.882046 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx592\" (UniqueName: \"kubernetes.io/projected/18078039-543c-40f6-bafc-fc957ab328ac-kube-api-access-wx592\") pod \"kuadrant-operator-catalog-px6z7\" (UID: \"18078039-543c-40f6-bafc-fc957ab328ac\") " pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:32.940231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:32.940202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:33.034183 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:33.034095 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:33.143673 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:33.143624 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:33.174185 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:33.174158 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-px6z7"] Jun 15 02:37:33.176239 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:37:33.176149 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18078039_543c_40f6_bafc_fc957ab328ac.slice/crio-ca0bf9f5bd828b856fd401f98e7f1d05222d9cd53c5571054da0cc886a49917f WatchSource:0}: Error finding container ca0bf9f5bd828b856fd401f98e7f1d05222d9cd53c5571054da0cc886a49917f: Status 404 returned error can't find the container with id ca0bf9f5bd828b856fd401f98e7f1d05222d9cd53c5571054da0cc886a49917f Jun 15 02:37:33.192400 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:33.192377 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" event={"ID":"16d0b0d0-ac16-474c-af7a-de6a22b9a6be","Type":"ContainerStarted","Data":"53f4decaba2fe3dbc85cf9f0a867cbc63a916449d06811dc8b5464d965a198ba"} Jun 15 02:37:33.193555 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:33.193533 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" event={"ID":"18078039-543c-40f6-bafc-fc957ab328ac","Type":"ContainerStarted","Data":"ca0bf9f5bd828b856fd401f98e7f1d05222d9cd53c5571054da0cc886a49917f"} Jun 15 02:37:35.209281 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.209243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" event={"ID":"18078039-543c-40f6-bafc-fc957ab328ac","Type":"ContainerStarted","Data":"79e17e51f8c9bbaaa86153dcf833e9794072c1c7ce48ef5abc3b75903616b169"} Jun 15 02:37:35.210752 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.210720 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" event={"ID":"16d0b0d0-ac16-474c-af7a-de6a22b9a6be","Type":"ContainerStarted","Data":"643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a"} Jun 15 02:37:35.210890 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.210772 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" podUID="16d0b0d0-ac16-474c-af7a-de6a22b9a6be" containerName="registry-server" containerID="cri-o://643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a" gracePeriod=2 Jun 15 02:37:35.225073 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.224949 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" podStartSLOduration=1.5920318660000001 podStartE2EDuration="3.224935535s" totalImagesPullingTime="1.632903669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:37:35.223311007 +0000 UTC m=+545.609233628" watchObservedRunningTime="2026-06-15 02:37:35.224935535 +0000 UTC m=+545.610858145" Jun 15 02:37:35.240287 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.240245 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" podStartSLOduration=1.030899134 podStartE2EDuration="3.240233973s" totalImagesPullingTime="2.209334839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:37:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:37:35.238129793 +0000 UTC m=+545.624052402" watchObservedRunningTime="2026-06-15 02:37:35.240233973 +0000 UTC m=+545.626156583" Jun 15 02:37:35.477532 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.477473 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:35.599681 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.599649 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcrz6\" (UniqueName: \"kubernetes.io/projected/16d0b0d0-ac16-474c-af7a-de6a22b9a6be-kube-api-access-mcrz6\") pod \"16d0b0d0-ac16-474c-af7a-de6a22b9a6be\" (UID: \"16d0b0d0-ac16-474c-af7a-de6a22b9a6be\") " Jun 15 02:37:35.602268 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.602233 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16d0b0d0-ac16-474c-af7a-de6a22b9a6be-kube-api-access-mcrz6" (OuterVolumeSpecName: "kube-api-access-mcrz6") pod "16d0b0d0-ac16-474c-af7a-de6a22b9a6be" (UID: "16d0b0d0-ac16-474c-af7a-de6a22b9a6be"). InnerVolumeSpecName "kube-api-access-mcrz6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:37:35.701278 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:35.701242 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcrz6\" (UniqueName: \"kubernetes.io/projected/16d0b0d0-ac16-474c-af7a-de6a22b9a6be-kube-api-access-mcrz6\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:37:36.215981 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.215943 2559 generic.go:356] "Generic (PLEG): container finished" podID="16d0b0d0-ac16-474c-af7a-de6a22b9a6be" containerID="643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a" exitCode=0 Jun 15 02:37:36.216456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.216010 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" Jun 15 02:37:36.216456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.216028 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" event={"ID":"16d0b0d0-ac16-474c-af7a-de6a22b9a6be","Type":"ContainerDied","Data":"643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a"} Jun 15 02:37:36.216456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.216078 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5pwwg" event={"ID":"16d0b0d0-ac16-474c-af7a-de6a22b9a6be","Type":"ContainerDied","Data":"53f4decaba2fe3dbc85cf9f0a867cbc63a916449d06811dc8b5464d965a198ba"} Jun 15 02:37:36.216456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.216100 2559 scope.go:117] "RemoveContainer" containerID="643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a" Jun 15 02:37:36.225628 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.225612 2559 scope.go:117] "RemoveContainer" containerID="643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a" Jun 15 02:37:36.225880 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:37:36.225865 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a\": container with ID starting with 643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a not found: ID does not exist" containerID="643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a" Jun 15 02:37:36.225934 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.225887 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a"} err="failed to get container status \"643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a\": rpc error: code = NotFound desc = could not find container \"643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a\": container with ID starting with 643454d53da7e833168cc06d9e4f75bbe73ef157af1d556473b0bdef9116e35a not found: ID does not exist" Jun 15 02:37:36.232435 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.232413 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5pwwg"] Jun 15 02:37:36.236246 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:36.236228 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5pwwg"] Jun 15 02:37:38.086122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:38.086086 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16d0b0d0-ac16-474c-af7a-de6a22b9a6be" path="/var/lib/kubelet/pods/16d0b0d0-ac16-474c-af7a-de6a22b9a6be/volumes" Jun 15 02:37:40.791931 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:40.791901 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:40.842800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:40.842769 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:37:43.035218 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:43.035181 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:43.035585 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:43.035279 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:43.057640 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:43.057607 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:43.271540 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:43.271514 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-px6z7" Jun 15 02:37:44.431842 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:37:44.431797 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:00.738579 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:00.738540 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:04.804747 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:04.804713 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:05.916751 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.916715 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn"] Jun 15 02:38:05.917298 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.917277 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16d0b0d0-ac16-474c-af7a-de6a22b9a6be" containerName="registry-server" Jun 15 02:38:05.917377 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.917303 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="16d0b0d0-ac16-474c-af7a-de6a22b9a6be" containerName="registry-server" Jun 15 02:38:05.917434 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.917417 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="16d0b0d0-ac16-474c-af7a-de6a22b9a6be" containerName="registry-server" Jun 15 02:38:05.920880 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.920860 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:05.923804 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.923787 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qtrb9\"" Jun 15 02:38:05.934184 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.934159 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn"] Jun 15 02:38:05.955467 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.955436 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c961134-1417-4d6d-8057-7cfa0cbc9680-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:05.955597 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:05.955490 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7jcz\" (UniqueName: \"kubernetes.io/projected/6c961134-1417-4d6d-8057-7cfa0cbc9680-kube-api-access-f7jcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:06.056427 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.056399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c961134-1417-4d6d-8057-7cfa0cbc9680-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:06.056561 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.056439 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7jcz\" (UniqueName: \"kubernetes.io/projected/6c961134-1417-4d6d-8057-7cfa0cbc9680-kube-api-access-f7jcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:06.056794 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.056770 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c961134-1417-4d6d-8057-7cfa0cbc9680-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:06.067630 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.067606 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7jcz\" (UniqueName: \"kubernetes.io/projected/6c961134-1417-4d6d-8057-7cfa0cbc9680-kube-api-access-f7jcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:06.136076 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.136048 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:06.231327 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.231254 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:06.376075 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.376047 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn"] Jun 15 02:38:06.378102 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:38:06.378075 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c961134_1417_4d6d_8057_7cfa0cbc9680.slice/crio-2dcb5081ce587be32cb558b233d248f79a2e0c9583b6680642243299d1acab94 WatchSource:0}: Error finding container 2dcb5081ce587be32cb558b233d248f79a2e0c9583b6680642243299d1acab94: Status 404 returned error can't find the container with id 2dcb5081ce587be32cb558b233d248f79a2e0c9583b6680642243299d1acab94 Jun 15 02:38:06.541120 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:06.541042 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:07.361063 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:07.361018 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" event={"ID":"6c961134-1417-4d6d-8057-7cfa0cbc9680","Type":"ContainerStarted","Data":"2dcb5081ce587be32cb558b233d248f79a2e0c9583b6680642243299d1acab94"} Jun 15 02:38:07.607268 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:07.607227 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:07.776483 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:07.776453 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:08.595558 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.595518 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5"] Jun 15 02:38:08.600187 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.600167 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:08.603172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.603152 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6xv2x\"" Jun 15 02:38:08.609583 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.609562 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5"] Jun 15 02:38:08.680168 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.680135 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx5fr\" (UniqueName: \"kubernetes.io/projected/6b53a396-32b0-4551-8a6a-d29023d13d17-kube-api-access-mx5fr\") pod \"authorino-operator-75cc8d5cb7-vlhg5\" (UID: \"6b53a396-32b0-4551-8a6a-d29023d13d17\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:08.780962 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.780930 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx5fr\" (UniqueName: \"kubernetes.io/projected/6b53a396-32b0-4551-8a6a-d29023d13d17-kube-api-access-mx5fr\") pod \"authorino-operator-75cc8d5cb7-vlhg5\" (UID: \"6b53a396-32b0-4551-8a6a-d29023d13d17\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:08.789611 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.789582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx5fr\" (UniqueName: \"kubernetes.io/projected/6b53a396-32b0-4551-8a6a-d29023d13d17-kube-api-access-mx5fr\") pod \"authorino-operator-75cc8d5cb7-vlhg5\" (UID: \"6b53a396-32b0-4551-8a6a-d29023d13d17\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:08.911628 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:08.911603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:09.051980 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:09.051955 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5"] Jun 15 02:38:09.053731 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:38:09.053704 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b53a396_32b0_4551_8a6a_d29023d13d17.slice/crio-5267d078cc143b4f42758a70a588629904a4f56fff2099a6ef1a1dd31efccb10 WatchSource:0}: Error finding container 5267d078cc143b4f42758a70a588629904a4f56fff2099a6ef1a1dd31efccb10: Status 404 returned error can't find the container with id 5267d078cc143b4f42758a70a588629904a4f56fff2099a6ef1a1dd31efccb10 Jun 15 02:38:09.159783 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:09.159743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:09.264514 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:09.264439 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:09.372556 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:09.372522 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" event={"ID":"6b53a396-32b0-4551-8a6a-d29023d13d17","Type":"ContainerStarted","Data":"5267d078cc143b4f42758a70a588629904a4f56fff2099a6ef1a1dd31efccb10"} Jun 15 02:38:11.358078 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:11.357976 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:12.391037 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:12.390979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" event={"ID":"6b53a396-32b0-4551-8a6a-d29023d13d17","Type":"ContainerStarted","Data":"242acb08324bacb1d10882a76e9535f55faf6e50d29710dc8c22b61cdbec0caa"} Jun 15 02:38:12.391468 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:12.391184 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:12.409072 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:12.409027 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" podStartSLOduration=2.01988196 podStartE2EDuration="4.40901419s" totalImagesPullingTime="2.38913223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:38:12.407161693 +0000 UTC m=+582.793084303" watchObservedRunningTime="2026-06-15 02:38:12.40901419 +0000 UTC m=+582.794936794" Jun 15 02:38:13.188928 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:13.188901 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:14.956538 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:14.956487 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:15.057502 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:15.057402 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:15.409468 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:15.409434 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" event={"ID":"6c961134-1417-4d6d-8057-7cfa0cbc9680","Type":"ContainerStarted","Data":"e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2"} Jun 15 02:38:15.409645 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:15.409575 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:15.431051 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:15.431001 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" podStartSLOduration=2.047483413 podStartE2EDuration="10.430974768s" totalImagesPullingTime="8.383491355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:38:15.428239049 +0000 UTC m=+585.814161659" watchObservedRunningTime="2026-06-15 02:38:15.430974768 +0000 UTC m=+585.816897377" Jun 15 02:38:17.565605 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:17.565572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:17.665719 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:17.665681 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:23.398049 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:23.398020 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vlhg5" Jun 15 02:38:25.364120 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:25.364089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:25.460743 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:25.460710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:25.984527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:25.984490 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:26.075842 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:26.075807 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:26.416714 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:26.416686 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:28.114407 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.114371 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn"] Jun 15 02:38:28.114815 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.114574 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" containerName="manager" containerID="cri-o://e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2" gracePeriod=2 Jun 15 02:38:28.126937 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.126905 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn"] Jun 15 02:38:28.140809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.140772 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc"] Jun 15 02:38:28.141333 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.141317 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" containerName="manager" Jun 15 02:38:28.141390 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.141338 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" containerName="manager" Jun 15 02:38:28.141466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.141454 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" containerName="manager" Jun 15 02:38:28.144810 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.144790 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.147358 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:28.147327 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" is forbidden: User \"system:node:ip-10-0-140-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-24.ec2.internal' and this object" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:28.158891 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.158864 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc"] Jun 15 02:38:28.270172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.270140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtlx4\" (UniqueName: \"kubernetes.io/projected/cc0cdd7f-2092-4326-873b-3778201a2945-kube-api-access-mtlx4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w94wc\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.270329 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.270192 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc0cdd7f-2092-4326-873b-3778201a2945-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w94wc\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.362219 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.362196 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:28.364583 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:28.364533 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" is forbidden: User \"system:node:ip-10-0-140-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-24.ec2.internal' and this object" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:28.370930 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.370905 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtlx4\" (UniqueName: \"kubernetes.io/projected/cc0cdd7f-2092-4326-873b-3778201a2945-kube-api-access-mtlx4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w94wc\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.371057 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.370960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc0cdd7f-2092-4326-873b-3778201a2945-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w94wc\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.371278 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.371260 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc0cdd7f-2092-4326-873b-3778201a2945-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w94wc\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.379536 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.379511 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtlx4\" (UniqueName: \"kubernetes.io/projected/cc0cdd7f-2092-4326-873b-3778201a2945-kube-api-access-mtlx4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-w94wc\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.471413 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.471379 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f7jcz\" (UniqueName: \"kubernetes.io/projected/6c961134-1417-4d6d-8057-7cfa0cbc9680-kube-api-access-f7jcz\") pod \"6c961134-1417-4d6d-8057-7cfa0cbc9680\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " Jun 15 02:38:28.471596 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.471461 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c961134-1417-4d6d-8057-7cfa0cbc9680-extensions-socket-volume\") pod \"6c961134-1417-4d6d-8057-7cfa0cbc9680\" (UID: \"6c961134-1417-4d6d-8057-7cfa0cbc9680\") " Jun 15 02:38:28.472113 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.472046 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c961134-1417-4d6d-8057-7cfa0cbc9680-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6c961134-1417-4d6d-8057-7cfa0cbc9680" (UID: "6c961134-1417-4d6d-8057-7cfa0cbc9680"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:38:28.472327 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.472303 2559 generic.go:356] "Generic (PLEG): container finished" podID="6c961134-1417-4d6d-8057-7cfa0cbc9680" containerID="e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2" exitCode=0 Jun 15 02:38:28.472453 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.472416 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:28.472572 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.472464 2559 scope.go:117] "RemoveContainer" containerID="e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2" Jun 15 02:38:28.473832 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.473798 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c961134-1417-4d6d-8057-7cfa0cbc9680-kube-api-access-f7jcz" (OuterVolumeSpecName: "kube-api-access-f7jcz") pod "6c961134-1417-4d6d-8057-7cfa0cbc9680" (UID: "6c961134-1417-4d6d-8057-7cfa0cbc9680"). InnerVolumeSpecName "kube-api-access-f7jcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:38:28.475070 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:28.475044 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" is forbidden: User \"system:node:ip-10-0-140-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-24.ec2.internal' and this object" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:28.485567 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.485549 2559 scope.go:117] "RemoveContainer" containerID="e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2" Jun 15 02:38:28.485634 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.485617 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:28.485822 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:28.485806 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2\": container with ID starting with e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2 not found: ID does not exist" containerID="e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2" Jun 15 02:38:28.485865 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.485829 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2"} err="failed to get container status \"e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2\": rpc error: code = NotFound desc = could not find container \"e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2\": container with ID starting with e88ad0b3b0a22162b7fb1101318e6289cbc20adfbb5ec5fe27bb0404160587f2 not found: ID does not exist" Jun 15 02:38:28.572581 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.572552 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f7jcz\" (UniqueName: \"kubernetes.io/projected/6c961134-1417-4d6d-8057-7cfa0cbc9680-kube-api-access-f7jcz\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:38:28.572686 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.572582 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6c961134-1417-4d6d-8057-7cfa0cbc9680-extensions-socket-volume\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:38:28.634972 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:28.634941 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc"] Jun 15 02:38:28.637805 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:38:28.637778 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0cdd7f_2092_4326_873b_3778201a2945.slice/crio-5abd6df15e08c9bdeffc8c4e555eb49f1ec15be7605ad4049c36101460b60c34 WatchSource:0}: Error finding container 5abd6df15e08c9bdeffc8c4e555eb49f1ec15be7605ad4049c36101460b60c34: Status 404 returned error can't find the container with id 5abd6df15e08c9bdeffc8c4e555eb49f1ec15be7605ad4049c36101460b60c34 Jun 15 02:38:28.782841 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:28.782813 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" is forbidden: User \"system:node:ip-10-0-140-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-24.ec2.internal' and this object" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:29.478837 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:29.478798 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" event={"ID":"cc0cdd7f-2092-4326-873b-3778201a2945","Type":"ContainerStarted","Data":"cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb"} Jun 15 02:38:29.479277 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:29.478861 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" event={"ID":"cc0cdd7f-2092-4326-873b-3778201a2945","Type":"ContainerStarted","Data":"5abd6df15e08c9bdeffc8c4e555eb49f1ec15be7605ad4049c36101460b60c34"} Jun 15 02:38:29.479277 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:29.479013 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:29.481172 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:29.481150 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" is forbidden: User \"system:node:ip-10-0-140-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-24.ec2.internal' and this object" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:29.501545 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:29.501498 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" podStartSLOduration=1.501484135 podStartE2EDuration="1.501484135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:38:29.498931446 +0000 UTC m=+599.884854057" watchObservedRunningTime="2026-06-15 02:38:29.501484135 +0000 UTC m=+599.887406744" Jun 15 02:38:29.780825 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:29.780725 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:29.875738 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:29.875709 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:30.070131 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:30.070107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:38:30.070969 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:30.070946 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:38:30.085110 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:38:30.085081 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-q5vmn\" is forbidden: User \"system:node:ip-10-0-140-24.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-24.ec2.internal' and this object" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-q5vmn" Jun 15 02:38:30.086674 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:30.086651 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c961134-1417-4d6d-8057-7cfa0cbc9680" path="/var/lib/kubelet/pods/6c961134-1417-4d6d-8057-7cfa0cbc9680/volumes" Jun 15 02:38:33.549705 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:33.549652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:33.649041 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:33.648981 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:39.343698 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:39.343661 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:39.443109 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:39.443076 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:40.488254 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:40.488226 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:38:41.448087 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:41.448052 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:41.501770 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:41.501743 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:49.145234 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:49.145158 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:49.199485 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:49.199454 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:49.748304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:49.748272 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:49.851882 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:49.851846 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:54.743794 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:54.743758 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:54.847085 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:54.847040 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:58.142915 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:58.142877 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:38:58.242845 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:38:58.242815 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:01.152078 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.152041 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc"] Jun 15 02:39:01.152534 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.152301 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" podUID="cc0cdd7f-2092-4326-873b-3778201a2945" containerName="manager" containerID="cri-o://cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb" gracePeriod=10 Jun 15 02:39:01.407800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.407776 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:39:01.461323 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.461292 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc0cdd7f-2092-4326-873b-3778201a2945-extensions-socket-volume\") pod \"cc0cdd7f-2092-4326-873b-3778201a2945\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " Jun 15 02:39:01.461491 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.461351 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtlx4\" (UniqueName: \"kubernetes.io/projected/cc0cdd7f-2092-4326-873b-3778201a2945-kube-api-access-mtlx4\") pod \"cc0cdd7f-2092-4326-873b-3778201a2945\" (UID: \"cc0cdd7f-2092-4326-873b-3778201a2945\") " Jun 15 02:39:01.461694 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.461671 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc0cdd7f-2092-4326-873b-3778201a2945-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc0cdd7f-2092-4326-873b-3778201a2945" (UID: "cc0cdd7f-2092-4326-873b-3778201a2945"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:39:01.463596 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.463570 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc0cdd7f-2092-4326-873b-3778201a2945-kube-api-access-mtlx4" (OuterVolumeSpecName: "kube-api-access-mtlx4") pod "cc0cdd7f-2092-4326-873b-3778201a2945" (UID: "cc0cdd7f-2092-4326-873b-3778201a2945"). InnerVolumeSpecName "kube-api-access-mtlx4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:39:01.562382 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.562349 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc0cdd7f-2092-4326-873b-3778201a2945-extensions-socket-volume\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:39:01.562382 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.562382 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtlx4\" (UniqueName: \"kubernetes.io/projected/cc0cdd7f-2092-4326-873b-3778201a2945-kube-api-access-mtlx4\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:39:01.637896 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.637862 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc0cdd7f-2092-4326-873b-3778201a2945" containerID="cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb" exitCode=0 Jun 15 02:39:01.637896 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.637917 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" Jun 15 02:39:01.638112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.637955 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" event={"ID":"cc0cdd7f-2092-4326-873b-3778201a2945","Type":"ContainerDied","Data":"cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb"} Jun 15 02:39:01.638112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.638027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc" event={"ID":"cc0cdd7f-2092-4326-873b-3778201a2945","Type":"ContainerDied","Data":"5abd6df15e08c9bdeffc8c4e555eb49f1ec15be7605ad4049c36101460b60c34"} Jun 15 02:39:01.638112 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.638057 2559 scope.go:117] "RemoveContainer" containerID="cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb" Jun 15 02:39:01.646838 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.646821 2559 scope.go:117] "RemoveContainer" containerID="cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb" Jun 15 02:39:01.647148 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:39:01.647130 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb\": container with ID starting with cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb not found: ID does not exist" containerID="cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb" Jun 15 02:39:01.647196 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.647158 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb"} err="failed to get container status \"cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb\": rpc error: code = NotFound desc = could not find container \"cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb\": container with ID starting with cfe75bfac7a45932cb952fc92cdf8a26dd2468a0edf11298eddf15e78090e7fb not found: ID does not exist" Jun 15 02:39:01.659677 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.659630 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc"] Jun 15 02:39:01.663153 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:01.663132 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-w94wc"] Jun 15 02:39:02.085480 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:02.085406 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc0cdd7f-2092-4326-873b-3778201a2945" path="/var/lib/kubelet/pods/cc0cdd7f-2092-4326-873b-3778201a2945/volumes" Jun 15 02:39:02.160529 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:02.160455 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:02.259701 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:02.259663 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:11.567260 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:11.567217 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:11.664122 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:11.664089 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:14.011540 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:14.011509 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:14.110554 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:14.110524 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:17.475739 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.475699 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r"] Jun 15 02:39:17.476291 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.476269 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc0cdd7f-2092-4326-873b-3778201a2945" containerName="manager" Jun 15 02:39:17.476372 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.476294 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc0cdd7f-2092-4326-873b-3778201a2945" containerName="manager" Jun 15 02:39:17.476429 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.476418 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc0cdd7f-2092-4326-873b-3778201a2945" containerName="manager" Jun 15 02:39:17.479056 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.479035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.481687 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.481665 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8d6dg\"" Jun 15 02:39:17.490367 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.490343 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r"] Jun 15 02:39:17.497612 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.497589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:17.598954 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.598923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.598968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599124 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599145 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.599304 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.599252 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6wwt\" (UniqueName: \"kubernetes.io/projected/4565b91d-f087-4faa-a8a2-1beb66ac73d9-kube-api-access-k6wwt\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700115 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700082 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700115 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700117 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700192 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700224 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700334 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700304 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6wwt\" (UniqueName: \"kubernetes.io/projected/4565b91d-f087-4faa-a8a2-1beb66ac73d9-kube-api-access-k6wwt\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700635 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700692 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700667 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700743 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700689 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700744 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700802 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700785 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.700909 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.700890 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.702844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.702822 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.702944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.702843 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.709538 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.709506 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6wwt\" (UniqueName: \"kubernetes.io/projected/4565b91d-f087-4faa-a8a2-1beb66ac73d9-kube-api-access-k6wwt\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.710002 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.709967 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4565b91d-f087-4faa-a8a2-1beb66ac73d9-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-srz2r\" (UID: \"4565b91d-f087-4faa-a8a2-1beb66ac73d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.721927 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.721893 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:17.795201 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.795137 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:17.933158 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.933135 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r"] Jun 15 02:39:17.934830 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:39:17.934802 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4565b91d_f087_4faa_a8a2_1beb66ac73d9.slice/crio-b110990d1e725c34e0b99ceb73296f6e23a595731ae540eae259b08fb53e1d4b WatchSource:0}: Error finding container b110990d1e725c34e0b99ceb73296f6e23a595731ae540eae259b08fb53e1d4b: Status 404 returned error can't find the container with id b110990d1e725c34e0b99ceb73296f6e23a595731ae540eae259b08fb53e1d4b Jun 15 02:39:17.936740 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.936705 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:39:17.936823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.936771 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:39:17.936823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:17.936799 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:39:18.722810 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.722769 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" event={"ID":"4565b91d-f087-4faa-a8a2-1beb66ac73d9","Type":"ContainerStarted","Data":"fbc9dfd24e2502e81ad5d988df3cb93d24b0310c35f1df95ed2d1e1f06ad8620"} Jun 15 02:39:18.723167 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.722826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" event={"ID":"4565b91d-f087-4faa-a8a2-1beb66ac73d9","Type":"ContainerStarted","Data":"b110990d1e725c34e0b99ceb73296f6e23a595731ae540eae259b08fb53e1d4b"} Jun 15 02:39:18.757311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.757262 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" podStartSLOduration=1.7572463040000001 podStartE2EDuration="1.757246304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:39:18.75520237 +0000 UTC m=+649.141124982" watchObservedRunningTime="2026-06-15 02:39:18.757246304 +0000 UTC m=+649.143168914" Jun 15 02:39:18.759158 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.759132 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:18.796126 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.796103 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:18.801189 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.801169 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:18.823527 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:18.823507 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:19.706193 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.706154 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:19.711023 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.710983 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:19.714394 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.714379 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:19.717249 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.717228 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jxn47\"" Jun 15 02:39:19.717380 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.717311 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 15 02:39:19.722769 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.722747 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:19.727455 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.727430 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:19.728423 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.728404 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:39:19.802655 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.802618 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:19.810401 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.810364 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:19.818575 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.818550 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-config-file\") pod \"limitador-limitador-64c94fd64f-jmkbt\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:19.818719 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.818615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtvz\" (UniqueName: \"kubernetes.io/projected/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-kube-api-access-2xtvz\") pod \"limitador-limitador-64c94fd64f-jmkbt\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:19.913727 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.913694 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:19.920303 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.920276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-config-file\") pod \"limitador-limitador-64c94fd64f-jmkbt\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:19.920413 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.920328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtvz\" (UniqueName: \"kubernetes.io/projected/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-kube-api-access-2xtvz\") pod \"limitador-limitador-64c94fd64f-jmkbt\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:19.920870 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.920851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-config-file\") pod \"limitador-limitador-64c94fd64f-jmkbt\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:19.929167 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:19.929144 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtvz\" (UniqueName: \"kubernetes.io/projected/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-kube-api-access-2xtvz\") pod \"limitador-limitador-64c94fd64f-jmkbt\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:20.026690 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.026603 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:20.180682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.180659 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:20.182333 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:39:20.182303 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdd2d5d_f8f9_4cd8_8439_4bb4dea06cae.slice/crio-6a7501a04228cd3bdfcd0f1969bcf8d2b1d971760ab1d9baabe6b6cc60c7297a WatchSource:0}: Error finding container 6a7501a04228cd3bdfcd0f1969bcf8d2b1d971760ab1d9baabe6b6cc60c7297a: Status 404 returned error can't find the container with id 6a7501a04228cd3bdfcd0f1969bcf8d2b1d971760ab1d9baabe6b6cc60c7297a Jun 15 02:39:20.246781 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.246753 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:20.312943 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.312875 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:20.649189 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.649118 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:20.702921 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.702869 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:20.733894 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:20.733864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" event={"ID":"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae","Type":"ContainerStarted","Data":"6a7501a04228cd3bdfcd0f1969bcf8d2b1d971760ab1d9baabe6b6cc60c7297a"} Jun 15 02:39:23.754708 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:23.754672 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" event={"ID":"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae","Type":"ContainerStarted","Data":"1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a"} Jun 15 02:39:23.755107 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:23.754792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:23.771918 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:23.771875 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" podStartSLOduration=1.849218096 podStartE2EDuration="4.771863109s" totalImagesPullingTime="2.922645013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:39:23.770446396 +0000 UTC m=+654.156369000" watchObservedRunningTime="2026-06-15 02:39:23.771863109 +0000 UTC m=+654.157785718" Jun 15 02:39:34.424455 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.424417 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:34.477429 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.477402 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:34.563832 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.563803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:34.631866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.631832 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:34.632097 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.632071 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" podUID="6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" containerName="limitador" containerID="cri-o://1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a" gracePeriod=30 Jun 15 02:39:34.632735 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.632719 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:34.637353 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:34.637332 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:35.165603 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.165555 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:35.190288 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.190262 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:35.216670 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.216616 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:35.252852 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.252827 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-config-file\") pod \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " Jun 15 02:39:35.252944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.252885 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xtvz\" (UniqueName: \"kubernetes.io/projected/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-kube-api-access-2xtvz\") pod \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\" (UID: \"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae\") " Jun 15 02:39:35.253195 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.253175 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-config-file" (OuterVolumeSpecName: "config-file") pod "6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" (UID: "6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:39:35.255000 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.254967 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-kube-api-access-2xtvz" (OuterVolumeSpecName: "kube-api-access-2xtvz") pod "6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" (UID: "6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae"). InnerVolumeSpecName "kube-api-access-2xtvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:39:35.353854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.353826 2559 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-config-file\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:39:35.353854 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.353853 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xtvz\" (UniqueName: \"kubernetes.io/projected/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae-kube-api-access-2xtvz\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:39:35.819231 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.819190 2559 generic.go:356] "Generic (PLEG): container finished" podID="6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" containerID="1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a" exitCode=0 Jun 15 02:39:35.819603 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.819236 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" Jun 15 02:39:35.819603 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.819250 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" event={"ID":"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae","Type":"ContainerDied","Data":"1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a"} Jun 15 02:39:35.819603 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.819302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-jmkbt" event={"ID":"6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae","Type":"ContainerDied","Data":"6a7501a04228cd3bdfcd0f1969bcf8d2b1d971760ab1d9baabe6b6cc60c7297a"} Jun 15 02:39:35.819603 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.819332 2559 scope.go:117] "RemoveContainer" containerID="1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a" Jun 15 02:39:35.828604 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.828586 2559 scope.go:117] "RemoveContainer" containerID="1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a" Jun 15 02:39:35.828851 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:39:35.828829 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a\": container with ID starting with 1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a not found: ID does not exist" containerID="1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a" Jun 15 02:39:35.828894 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.828859 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a"} err="failed to get container status \"1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a\": rpc error: code = NotFound desc = could not find container \"1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a\": container with ID starting with 1f31ddeff5ae7195e8b4983e61cc451ce50e09f29943d1f07bae05001e393e0a not found: ID does not exist" Jun 15 02:39:35.839947 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.839924 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:35.842389 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:35.842369 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-jmkbt"] Jun 15 02:39:36.086491 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.086416 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" path="/var/lib/kubelet/pods/6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae/volumes" Jun 15 02:39:36.126587 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.126558 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-mnpsc"] Jun 15 02:39:36.127095 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.127067 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" containerName="limitador" Jun 15 02:39:36.127095 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.127094 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" containerName="limitador" Jun 15 02:39:36.127232 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.127177 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cdd2d5d-f8f9-4cd8-8439-4bb4dea06cae" containerName="limitador" Jun 15 02:39:36.131437 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.131418 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.134067 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.134047 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 15 02:39:36.138251 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.138199 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mnpsc"] Jun 15 02:39:36.158917 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.158888 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b00a76b5-fac6-4650-b950-d96267abe4e9-data\") pod \"postgres-69fb4594cf-mnpsc\" (UID: \"b00a76b5-fac6-4650-b950-d96267abe4e9\") " pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.159080 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.159043 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w92t4\" (UniqueName: \"kubernetes.io/projected/b00a76b5-fac6-4650-b950-d96267abe4e9-kube-api-access-w92t4\") pod \"postgres-69fb4594cf-mnpsc\" (UID: \"b00a76b5-fac6-4650-b950-d96267abe4e9\") " pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.162296 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.162277 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:36.260147 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.260120 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b00a76b5-fac6-4650-b950-d96267abe4e9-data\") pod \"postgres-69fb4594cf-mnpsc\" (UID: \"b00a76b5-fac6-4650-b950-d96267abe4e9\") " pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.260311 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.260220 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w92t4\" (UniqueName: \"kubernetes.io/projected/b00a76b5-fac6-4650-b950-d96267abe4e9-kube-api-access-w92t4\") pod \"postgres-69fb4594cf-mnpsc\" (UID: \"b00a76b5-fac6-4650-b950-d96267abe4e9\") " pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.260486 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.260469 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b00a76b5-fac6-4650-b950-d96267abe4e9-data\") pod \"postgres-69fb4594cf-mnpsc\" (UID: \"b00a76b5-fac6-4650-b950-d96267abe4e9\") " pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.268365 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.268340 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w92t4\" (UniqueName: \"kubernetes.io/projected/b00a76b5-fac6-4650-b950-d96267abe4e9-kube-api-access-w92t4\") pod \"postgres-69fb4594cf-mnpsc\" (UID: \"b00a76b5-fac6-4650-b950-d96267abe4e9\") " pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.443335 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.443304 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:36.577237 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.577210 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-mnpsc"] Jun 15 02:39:36.579838 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:39:36.579793 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb00a76b5_fac6_4650_b950_d96267abe4e9.slice/crio-721f872251289042c84255cab60c28f87ce06c1c2a79d58dae2ddef0687a1f41 WatchSource:0}: Error finding container 721f872251289042c84255cab60c28f87ce06c1c2a79d58dae2ddef0687a1f41: Status 404 returned error can't find the container with id 721f872251289042c84255cab60c28f87ce06c1c2a79d58dae2ddef0687a1f41 Jun 15 02:39:36.825592 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:36.825487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mnpsc" event={"ID":"b00a76b5-fac6-4650-b950-d96267abe4e9","Type":"ContainerStarted","Data":"721f872251289042c84255cab60c28f87ce06c1c2a79d58dae2ddef0687a1f41"} Jun 15 02:39:39.843805 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:39.843762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-mnpsc" event={"ID":"b00a76b5-fac6-4650-b950-d96267abe4e9","Type":"ContainerStarted","Data":"58bc24124b53737f53dc9cd49dcace762322f3b521d2aaa9633cb7ffe17701ea"} Jun 15 02:39:39.844233 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:39.843896 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:39.859494 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:39.859443 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-mnpsc" podStartSLOduration=1.503579979 podStartE2EDuration="3.859427149s" totalImagesPullingTime="2.35584717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:39:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:39:39.858062586 +0000 UTC m=+670.243985196" watchObservedRunningTime="2026-06-15 02:39:39.859427149 +0000 UTC m=+670.245349759" Jun 15 02:39:45.549318 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:45.549284 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:45.596261 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:45.596232 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:45.649452 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:45.649425 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:45.698613 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:45.698589 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:45.882313 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:45.882251 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-mnpsc" Jun 15 02:39:46.177417 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:46.177389 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:46.275093 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:46.275059 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:46.425383 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:46.425356 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:39:54.712506 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.712474 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bn87z"] Jun 15 02:39:54.715904 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.715887 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" Jun 15 02:39:54.718643 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.718615 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 02:39:54.718756 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.718693 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 02:39:54.719897 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.719878 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-56c56\"" Jun 15 02:39:54.723413 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.723391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bn87z"] Jun 15 02:39:54.824318 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.824280 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcrj2\" (UniqueName: \"kubernetes.io/projected/b785a546-0df2-40ce-8ada-c3a76d5afc25-kube-api-access-lcrj2\") pod \"keycloak-operator-d67dbbb48-bn87z\" (UID: \"b785a546-0df2-40ce-8ada-c3a76d5afc25\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" Jun 15 02:39:54.925681 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.925653 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcrj2\" (UniqueName: \"kubernetes.io/projected/b785a546-0df2-40ce-8ada-c3a76d5afc25-kube-api-access-lcrj2\") pod \"keycloak-operator-d67dbbb48-bn87z\" (UID: \"b785a546-0df2-40ce-8ada-c3a76d5afc25\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" Jun 15 02:39:54.933935 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:54.933905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcrj2\" (UniqueName: \"kubernetes.io/projected/b785a546-0df2-40ce-8ada-c3a76d5afc25-kube-api-access-lcrj2\") pod \"keycloak-operator-d67dbbb48-bn87z\" (UID: \"b785a546-0df2-40ce-8ada-c3a76d5afc25\") " pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" Jun 15 02:39:55.026406 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:55.026344 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" Jun 15 02:39:55.156236 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:55.156208 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-bn87z"] Jun 15 02:39:55.158095 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:39:55.158056 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb785a546_0df2_40ce_8ada_c3a76d5afc25.slice/crio-03d3ddc8f0e08d086aaae219b7bc48f3537eb31898a4cac6dbb06ff83d4bfb20 WatchSource:0}: Error finding container 03d3ddc8f0e08d086aaae219b7bc48f3537eb31898a4cac6dbb06ff83d4bfb20: Status 404 returned error can't find the container with id 03d3ddc8f0e08d086aaae219b7bc48f3537eb31898a4cac6dbb06ff83d4bfb20 Jun 15 02:39:55.925402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:39:55.925361 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" event={"ID":"b785a546-0df2-40ce-8ada-c3a76d5afc25","Type":"ContainerStarted","Data":"03d3ddc8f0e08d086aaae219b7bc48f3537eb31898a4cac6dbb06ff83d4bfb20"} Jun 15 02:40:01.961975 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:01.961933 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" event={"ID":"b785a546-0df2-40ce-8ada-c3a76d5afc25","Type":"ContainerStarted","Data":"74f4300e30160e88196f17cb8bc5ac22e3709db5f8bea0319604453f6efbb9dc"} Jun 15 02:40:01.980079 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:01.980030 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-bn87z" podStartSLOduration=1.900911424 podStartE2EDuration="7.9800154s" totalImagesPullingTime="6.079103976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:40:01.977538415 +0000 UTC m=+692.363461025" watchObservedRunningTime="2026-06-15 02:40:01.9800154 +0000 UTC m=+692.365938010" Jun 15 02:40:10.548950 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.548918 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:10.648940 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.648903 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:10.959870 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.959832 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:40:10.963413 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.963389 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:10.966347 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.966298 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-pk2zp\"" Jun 15 02:40:10.966466 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.966370 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 02:40:10.972536 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:10.972513 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:40:11.078308 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:11.078274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdvm7\" (UniqueName: \"kubernetes.io/projected/dc833fd8-5c02-4fc3-948c-65b0c33489b5-kube-api-access-rdvm7\") pod \"maas-keycloak-0\" (UID: \"dc833fd8-5c02-4fc3-948c-65b0c33489b5\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:11.179404 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:11.179368 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdvm7\" (UniqueName: \"kubernetes.io/projected/dc833fd8-5c02-4fc3-948c-65b0c33489b5-kube-api-access-rdvm7\") pod \"maas-keycloak-0\" (UID: \"dc833fd8-5c02-4fc3-948c-65b0c33489b5\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:11.188502 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:11.188472 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdvm7\" (UniqueName: \"kubernetes.io/projected/dc833fd8-5c02-4fc3-948c-65b0c33489b5-kube-api-access-rdvm7\") pod \"maas-keycloak-0\" (UID: \"dc833fd8-5c02-4fc3-948c-65b0c33489b5\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:11.274188 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:11.274099 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:11.412496 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:11.412463 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:40:11.414249 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:40:11.414222 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc833fd8_5c02_4fc3_948c_65b0c33489b5.slice/crio-59cf0b0b5fe1e42a56e5eeccfb883b7b87697ccc5b095f79755fe140ec030b6d WatchSource:0}: Error finding container 59cf0b0b5fe1e42a56e5eeccfb883b7b87697ccc5b095f79755fe140ec030b6d: Status 404 returned error can't find the container with id 59cf0b0b5fe1e42a56e5eeccfb883b7b87697ccc5b095f79755fe140ec030b6d Jun 15 02:40:12.017501 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:12.017464 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dc833fd8-5c02-4fc3-948c-65b0c33489b5","Type":"ContainerStarted","Data":"59cf0b0b5fe1e42a56e5eeccfb883b7b87697ccc5b095f79755fe140ec030b6d"} Jun 15 02:40:16.046823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:16.046713 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dc833fd8-5c02-4fc3-948c-65b0c33489b5","Type":"ContainerStarted","Data":"3f4de9854c275522da693bf4e45eb6d1544dbd601bb8d86080b12d168f4ac9c9"} Jun 15 02:40:16.063163 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:16.063099 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.7351089530000001 podStartE2EDuration="6.063079811s" totalImagesPullingTime="4.327970858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:40:16.062861353 +0000 UTC m=+706.448783963" watchObservedRunningTime="2026-06-15 02:40:16.063079811 +0000 UTC m=+706.449002422" Jun 15 02:40:16.275222 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:16.275178 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:16.277270 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:16.277238 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:17.275262 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:17.275168 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:18.275383 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:18.275344 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:19.275054 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:19.275006 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:20.275303 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:20.275255 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:21.274775 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:21.274350 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:21.275296 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:21.275259 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:22.275379 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:22.275324 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:23.275630 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:23.275579 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:24.275012 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:24.274953 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:25.275177 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:25.275123 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:26.275160 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:26.275110 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:27.274537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:27.274491 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:28.275629 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:28.275575 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 15 02:40:29.402347 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:29.402308 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:29.420935 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:29.420895 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 02:40:39.408166 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:39.408129 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 02:40:40.063748 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:40.063710 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:40.276683 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:40.276617 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:45.222752 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:45.222700 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:45.321259 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:45.321226 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:45.376004 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:45.375968 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:47.719679 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:47.719638 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:40:47.795715 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:40:47.795680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:41:04.466282 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:04.466246 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:41:18.232899 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.232857 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:41:18.293452 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.293422 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-c9ff44f6c-29hlh"] Jun 15 02:41:18.299563 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.299546 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.302401 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.302378 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9qfwk\"" Jun 15 02:41:18.302774 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.302756 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 02:41:18.311543 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.311518 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c9ff44f6c-29hlh"] Jun 15 02:41:18.405507 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.405469 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:41:18.412616 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.412590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-maas-api-tls\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.412616 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.412620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-openshift-service-ca\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.412778 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.412638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j87jw\" (UniqueName: \"kubernetes.io/projected/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-kube-api-access-j87jw\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.513815 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.513739 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-maas-api-tls\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.513815 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.513773 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-openshift-service-ca\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.513815 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.513797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j87jw\" (UniqueName: \"kubernetes.io/projected/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-kube-api-access-j87jw\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.514457 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.514438 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-openshift-service-ca\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.516277 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.516258 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-maas-api-tls\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.521858 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.521838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j87jw\" (UniqueName: \"kubernetes.io/projected/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-kube-api-access-j87jw\") pod \"maas-api-c9ff44f6c-29hlh\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.613919 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.613882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:18.731209 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.731178 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:41:18.762400 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.762375 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-c9ff44f6c-29hlh"] Jun 15 02:41:18.764521 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:41:18.764465 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcadd5fce_d6d3_41c4_9beb_0ebc6d5ea2ba.slice/crio-43792ef0302f91e264a78424ebbf9f7a0b307fbf47ea4095ace757478c0b560d WatchSource:0}: Error finding container 43792ef0302f91e264a78424ebbf9f7a0b307fbf47ea4095ace757478c0b560d: Status 404 returned error can't find the container with id 43792ef0302f91e264a78424ebbf9f7a0b307fbf47ea4095ace757478c0b560d Jun 15 02:41:18.765866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.765845 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:41:18.828532 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:18.828504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:41:19.402682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:19.402600 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c9ff44f6c-29hlh" event={"ID":"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba","Type":"ContainerStarted","Data":"43792ef0302f91e264a78424ebbf9f7a0b307fbf47ea4095ace757478c0b560d"} Jun 15 02:41:22.434238 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:22.434204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c9ff44f6c-29hlh" event={"ID":"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba","Type":"ContainerStarted","Data":"cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2"} Jun 15 02:41:22.434659 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:22.434323 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:22.451911 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:22.451852 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-c9ff44f6c-29hlh" podStartSLOduration=1.742932033 podStartE2EDuration="4.451837733s" totalImagesPullingTime="2.7089057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:41:22.44986441 +0000 UTC m=+772.835787035" watchObservedRunningTime="2026-06-15 02:41:22.451837733 +0000 UTC m=+772.837760344" Jun 15 02:41:27.463286 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:27.463249 2559 generic.go:356] "Generic (PLEG): container finished" podID="4565b91d-f087-4faa-a8a2-1beb66ac73d9" containerID="fbc9dfd24e2502e81ad5d988df3cb93d24b0310c35f1df95ed2d1e1f06ad8620" exitCode=0 Jun 15 02:41:27.463810 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:27.463307 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" event={"ID":"4565b91d-f087-4faa-a8a2-1beb66ac73d9","Type":"ContainerDied","Data":"fbc9dfd24e2502e81ad5d988df3cb93d24b0310c35f1df95ed2d1e1f06ad8620"} Jun 15 02:41:27.463887 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:27.463813 2559 scope.go:117] "RemoveContainer" containerID="fbc9dfd24e2502e81ad5d988df3cb93d24b0310c35f1df95ed2d1e1f06ad8620" Jun 15 02:41:27.465253 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:27.465117 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:41:27.465253 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:27.465206 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:41:27.465415 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:27.465264 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 15 02:41:28.445624 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:28.445596 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:41:28.470643 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:28.470613 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" event={"ID":"4565b91d-f087-4faa-a8a2-1beb66ac73d9","Type":"ContainerStarted","Data":"611cc4fb23d658fcdf1c54fe6ec5f1e8dfba513ccaff2b03b49a5b68dd924b34"} Jun 15 02:41:28.796385 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:28.796287 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:41:28.796586 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:28.796555 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-srz2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 02:41:28.796656 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:28.796627 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" podUID="4565b91d-f087-4faa-a8a2-1beb66ac73d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 02:41:29.648128 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:29.648084 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:41:29.648583 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:29.648323 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" containerID="cri-o://3f4de9854c275522da693bf4e45eb6d1544dbd601bb8d86080b12d168f4ac9c9" gracePeriod=30 Jun 15 02:41:29.796356 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:29.796314 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-srz2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 02:41:29.796566 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:29.796392 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" podUID="4565b91d-f087-4faa-a8a2-1beb66ac73d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 02:41:30.795870 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:30.795835 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-srz2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 02:41:30.796332 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:30.795890 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" podUID="4565b91d-f087-4faa-a8a2-1beb66ac73d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 02:41:31.493211 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.493179 2559 generic.go:356] "Generic (PLEG): container finished" podID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerID="3f4de9854c275522da693bf4e45eb6d1544dbd601bb8d86080b12d168f4ac9c9" exitCode=143 Jun 15 02:41:31.493211 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.493218 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dc833fd8-5c02-4fc3-948c-65b0c33489b5","Type":"ContainerDied","Data":"3f4de9854c275522da693bf4e45eb6d1544dbd601bb8d86080b12d168f4ac9c9"} Jun 15 02:41:31.743776 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.743726 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:31.795676 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.795641 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-srz2r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body= Jun 15 02:41:31.795856 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.795695 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" podUID="4565b91d-f087-4faa-a8a2-1beb66ac73d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" Jun 15 02:41:31.840238 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.840198 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdvm7\" (UniqueName: \"kubernetes.io/projected/dc833fd8-5c02-4fc3-948c-65b0c33489b5-kube-api-access-rdvm7\") pod \"dc833fd8-5c02-4fc3-948c-65b0c33489b5\" (UID: \"dc833fd8-5c02-4fc3-948c-65b0c33489b5\") " Jun 15 02:41:31.842880 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.842839 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc833fd8-5c02-4fc3-948c-65b0c33489b5-kube-api-access-rdvm7" (OuterVolumeSpecName: "kube-api-access-rdvm7") pod "dc833fd8-5c02-4fc3-948c-65b0c33489b5" (UID: "dc833fd8-5c02-4fc3-948c-65b0c33489b5"). InnerVolumeSpecName "kube-api-access-rdvm7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:41:31.941884 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:31.941857 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdvm7\" (UniqueName: \"kubernetes.io/projected/dc833fd8-5c02-4fc3-948c-65b0c33489b5-kube-api-access-rdvm7\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:41:32.499430 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.499390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dc833fd8-5c02-4fc3-948c-65b0c33489b5","Type":"ContainerDied","Data":"59cf0b0b5fe1e42a56e5eeccfb883b7b87697ccc5b095f79755fe140ec030b6d"} Jun 15 02:41:32.499592 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.499455 2559 scope.go:117] "RemoveContainer" containerID="3f4de9854c275522da693bf4e45eb6d1544dbd601bb8d86080b12d168f4ac9c9" Jun 15 02:41:32.499592 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.499408 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.516674 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.516647 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:41:32.521702 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.521674 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:41:32.542760 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.542726 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:41:32.543167 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.543147 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" Jun 15 02:41:32.543262 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.543170 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" Jun 15 02:41:32.543320 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.543292 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" containerName="keycloak" Jun 15 02:41:32.548357 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.548331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.551116 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.551090 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 02:41:32.551224 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.551163 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-pk2zp\"" Jun 15 02:41:32.551296 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.551221 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 02:41:32.556502 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.556441 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:41:32.649948 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.649908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9785250b-a392-4246-a00e-6727c369332d-test-realms\") pod \"maas-keycloak-0\" (UID: \"9785250b-a392-4246-a00e-6727c369332d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.650145 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.650036 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v46tq\" (UniqueName: \"kubernetes.io/projected/9785250b-a392-4246-a00e-6727c369332d-kube-api-access-v46tq\") pod \"maas-keycloak-0\" (UID: \"9785250b-a392-4246-a00e-6727c369332d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.751253 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.751170 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v46tq\" (UniqueName: \"kubernetes.io/projected/9785250b-a392-4246-a00e-6727c369332d-kube-api-access-v46tq\") pod \"maas-keycloak-0\" (UID: \"9785250b-a392-4246-a00e-6727c369332d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.751253 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.751228 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9785250b-a392-4246-a00e-6727c369332d-test-realms\") pod \"maas-keycloak-0\" (UID: \"9785250b-a392-4246-a00e-6727c369332d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.751873 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.751855 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9785250b-a392-4246-a00e-6727c369332d-test-realms\") pod \"maas-keycloak-0\" (UID: \"9785250b-a392-4246-a00e-6727c369332d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.759786 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.759758 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v46tq\" (UniqueName: \"kubernetes.io/projected/9785250b-a392-4246-a00e-6727c369332d-kube-api-access-v46tq\") pod \"maas-keycloak-0\" (UID: \"9785250b-a392-4246-a00e-6727c369332d\") " pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:32.800031 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.799976 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:41:32.800312 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.800294 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:41:32.800866 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.800849 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-srz2r" Jun 15 02:41:32.861962 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:32.861913 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:33.005817 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:33.005791 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 02:41:33.008297 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:41:33.008267 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9785250b_a392_4246_a00e_6727c369332d.slice/crio-ab32d4cdf736680e7696061159c32a0f665f5369986c79366d6c89c76bd28468 WatchSource:0}: Error finding container ab32d4cdf736680e7696061159c32a0f665f5369986c79366d6c89c76bd28468: Status 404 returned error can't find the container with id ab32d4cdf736680e7696061159c32a0f665f5369986c79366d6c89c76bd28468 Jun 15 02:41:33.506504 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:33.506471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9785250b-a392-4246-a00e-6727c369332d","Type":"ContainerStarted","Data":"93ce2f9bb29780ddd736510dfa630f628f7ca09fde8cc8d2333c154e0e075821"} Jun 15 02:41:33.506688 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:33.506521 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9785250b-a392-4246-a00e-6727c369332d","Type":"ContainerStarted","Data":"ab32d4cdf736680e7696061159c32a0f665f5369986c79366d6c89c76bd28468"} Jun 15 02:41:33.525517 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:33.525465 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.194793495 podStartE2EDuration="1.52544963s" totalImagesPullingTime="330.656135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:41:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:41:33.523313229 +0000 UTC m=+783.909235837" watchObservedRunningTime="2026-06-15 02:41:33.52544963 +0000 UTC m=+783.911372240" Jun 15 02:41:33.862300 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:33.862260 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:33.863844 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:33.863813 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:34.087599 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:34.087566 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc833fd8-5c02-4fc3-948c-65b0c33489b5" path="/var/lib/kubelet/pods/dc833fd8-5c02-4fc3-948c-65b0c33489b5/volumes" Jun 15 02:41:34.863350 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:34.863294 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:35.863102 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:35.863061 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:36.863182 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:36.863132 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:37.862526 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:37.862482 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:38.862914 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:38.862860 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:39.863257 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:39.863200 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:40.862652 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:40.862599 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:41.862535 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:41.862480 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:42.862407 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:42.862365 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:42.862744 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:42.862712 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:43.863202 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:43.863146 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:44.863127 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:44.863088 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:45.862968 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:45.862916 2559 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.41:9000/health/started\": dial tcp 10.133.0.41:9000: connect: connection refused" Jun 15 02:41:46.991196 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:46.991100 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 02:41:47.011151 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:47.011019 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9785250b-a392-4246-a00e-6727c369332d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 02:41:56.997898 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:41:56.997856 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 02:42:09.850852 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:09.850807 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:09.951528 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:09.951494 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:19.833841 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:19.833803 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:35.640186 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:35.640151 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:36.681384 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:36.681351 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:37.676434 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:37.676396 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:37.728710 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:37.728680 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:41.694443 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:41.694412 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:51.422347 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:51.422309 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:42:53.907812 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:42:53.907778 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:43:00.372933 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:43:00.372896 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:43:30.106058 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:43:30.106032 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:43:30.106494 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:43:30.106479 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:44:17.180433 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:44:17.180399 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:44:17.272684 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:44:17.272647 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:44:18.327801 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:44:18.327772 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:44:18.429043 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:44:18.428971 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:44:27.452142 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:44:27.452106 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:45:00.139172 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.139135 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691525-fq7pm"] Jun 15 02:45:00.142773 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.142756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:00.149490 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.149466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691525-fq7pm"] Jun 15 02:45:00.313393 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.313356 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt7xk\" (UniqueName: \"kubernetes.io/projected/b76a08de-9c29-4b91-a624-206bb495ebe5-kube-api-access-gt7xk\") pod \"maas-api-key-cleanup-29691525-fq7pm\" (UID: \"b76a08de-9c29-4b91-a624-206bb495ebe5\") " pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:00.414555 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.414526 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt7xk\" (UniqueName: \"kubernetes.io/projected/b76a08de-9c29-4b91-a624-206bb495ebe5-kube-api-access-gt7xk\") pod \"maas-api-key-cleanup-29691525-fq7pm\" (UID: \"b76a08de-9c29-4b91-a624-206bb495ebe5\") " pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:00.423735 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.423710 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt7xk\" (UniqueName: \"kubernetes.io/projected/b76a08de-9c29-4b91-a624-206bb495ebe5-kube-api-access-gt7xk\") pod \"maas-api-key-cleanup-29691525-fq7pm\" (UID: \"b76a08de-9c29-4b91-a624-206bb495ebe5\") " pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:00.454817 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.454792 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:00.588886 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:00.588857 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691525-fq7pm"] Jun 15 02:45:00.591209 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:45:00.591176 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76a08de_9c29_4b91_a624_206bb495ebe5.slice/crio-7cdf28a1868c895d516ea959b41013c5e38ade27543e89a41a73c0aa001dbfeb WatchSource:0}: Error finding container 7cdf28a1868c895d516ea959b41013c5e38ade27543e89a41a73c0aa001dbfeb: Status 404 returned error can't find the container with id 7cdf28a1868c895d516ea959b41013c5e38ade27543e89a41a73c0aa001dbfeb Jun 15 02:45:01.590288 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:01.590248 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" event={"ID":"b76a08de-9c29-4b91-a624-206bb495ebe5","Type":"ContainerStarted","Data":"7cdf28a1868c895d516ea959b41013c5e38ade27543e89a41a73c0aa001dbfeb"} Jun 15 02:45:03.604623 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:03.604587 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" event={"ID":"b76a08de-9c29-4b91-a624-206bb495ebe5","Type":"ContainerStarted","Data":"a3aa48e73b90944e22f72b8dae4d50d63bfeaefdf219cc7b10c69182e3d1fea0"} Jun 15 02:45:03.624783 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:03.624731 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" podStartSLOduration=1.400464492 podStartE2EDuration="3.624713347s" totalImagesPullingTime="2.224248855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:45:03.622640117 +0000 UTC m=+994.008562729" watchObservedRunningTime="2026-06-15 02:45:03.624713347 +0000 UTC m=+994.010635958" Jun 15 02:45:04.611161 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:04.611119 2559 generic.go:356] "Generic (PLEG): container finished" podID="b76a08de-9c29-4b91-a624-206bb495ebe5" containerID="a3aa48e73b90944e22f72b8dae4d50d63bfeaefdf219cc7b10c69182e3d1fea0" exitCode=0 Jun 15 02:45:04.611581 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:04.611208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" event={"ID":"b76a08de-9c29-4b91-a624-206bb495ebe5","Type":"ContainerDied","Data":"a3aa48e73b90944e22f72b8dae4d50d63bfeaefdf219cc7b10c69182e3d1fea0"} Jun 15 02:45:05.758073 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:05.758051 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:05.862596 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:05.862569 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt7xk\" (UniqueName: \"kubernetes.io/projected/b76a08de-9c29-4b91-a624-206bb495ebe5-kube-api-access-gt7xk\") pod \"b76a08de-9c29-4b91-a624-206bb495ebe5\" (UID: \"b76a08de-9c29-4b91-a624-206bb495ebe5\") " Jun 15 02:45:05.864772 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:05.864744 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76a08de-9c29-4b91-a624-206bb495ebe5-kube-api-access-gt7xk" (OuterVolumeSpecName: "kube-api-access-gt7xk") pod "b76a08de-9c29-4b91-a624-206bb495ebe5" (UID: "b76a08de-9c29-4b91-a624-206bb495ebe5"). InnerVolumeSpecName "kube-api-access-gt7xk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:45:05.963454 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:05.963418 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt7xk\" (UniqueName: \"kubernetes.io/projected/b76a08de-9c29-4b91-a624-206bb495ebe5-kube-api-access-gt7xk\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:45:06.622209 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:06.622180 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" Jun 15 02:45:06.622380 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:06.622223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691525-fq7pm" event={"ID":"b76a08de-9c29-4b91-a624-206bb495ebe5","Type":"ContainerDied","Data":"7cdf28a1868c895d516ea959b41013c5e38ade27543e89a41a73c0aa001dbfeb"} Jun 15 02:45:06.622380 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:06.622266 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cdf28a1868c895d516ea959b41013c5e38ade27543e89a41a73c0aa001dbfeb" Jun 15 02:45:33.273455 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:33.273410 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:45:46.036639 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:46.036605 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:45:47.434669 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:45:47.434629 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:20.231458 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:20.231418 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:20.278537 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:20.278485 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:29.144115 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.144074 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:29.243574 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.243543 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:29.309812 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.309779 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-655b5959f7-rcklk"] Jun 15 02:46:29.310257 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.310239 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76a08de-9c29-4b91-a624-206bb495ebe5" containerName="cleanup" Jun 15 02:46:29.310257 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.310258 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76a08de-9c29-4b91-a624-206bb495ebe5" containerName="cleanup" Jun 15 02:46:29.310372 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.310362 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76a08de-9c29-4b91-a624-206bb495ebe5" containerName="cleanup" Jun 15 02:46:29.313582 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.313564 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.325367 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.325345 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-655b5959f7-rcklk"] Jun 15 02:46:29.337621 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.337597 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:29.422695 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.422667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-openshift-service-ca\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.422838 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.422710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2jt8\" (UniqueName: \"kubernetes.io/projected/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-kube-api-access-p2jt8\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.422838 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.422767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-maas-api-tls\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.524356 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.524316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-openshift-service-ca\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.524500 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.524366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2jt8\" (UniqueName: \"kubernetes.io/projected/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-kube-api-access-p2jt8\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.524500 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.524408 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-maas-api-tls\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.524945 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.524921 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-openshift-service-ca\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.526907 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.526880 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-maas-api-tls\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.532378 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.532359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2jt8\" (UniqueName: \"kubernetes.io/projected/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-kube-api-access-p2jt8\") pod \"maas-api-655b5959f7-rcklk\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.625106 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.625078 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:29.763244 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.763215 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-655b5959f7-rcklk"] Jun 15 02:46:29.765370 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:46:29.765341 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bad20d3_db2a_4fb8_a6fa_7c46b63badc4.slice/crio-c1485297f768ecfc2c1a6a8bce1296efb4f1e94563c1b50e52611958ae9c9584 WatchSource:0}: Error finding container c1485297f768ecfc2c1a6a8bce1296efb4f1e94563c1b50e52611958ae9c9584: Status 404 returned error can't find the container with id c1485297f768ecfc2c1a6a8bce1296efb4f1e94563c1b50e52611958ae9c9584 Jun 15 02:46:29.766821 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.766800 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:46:29.896561 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.896520 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:29.998432 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:29.998348 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:30.056708 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:30.056677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-655b5959f7-rcklk" event={"ID":"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4","Type":"ContainerStarted","Data":"c1485297f768ecfc2c1a6a8bce1296efb4f1e94563c1b50e52611958ae9c9584"} Jun 15 02:46:31.063529 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:31.063491 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-655b5959f7-rcklk" event={"ID":"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4","Type":"ContainerStarted","Data":"b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a"} Jun 15 02:46:31.063908 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:31.063612 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:31.081570 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:31.081520 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-655b5959f7-rcklk" podStartSLOduration=1.684179082 podStartE2EDuration="2.081505817s" totalImagesPullingTime="397.326735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:46:31.0796675 +0000 UTC m=+1081.465590135" watchObservedRunningTime="2026-06-15 02:46:31.081505817 +0000 UTC m=+1081.467428426" Jun 15 02:46:37.074299 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:37.074269 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:46:37.118314 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:37.118279 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-c9ff44f6c-29hlh"] Jun 15 02:46:37.118544 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:37.118517 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-c9ff44f6c-29hlh" podUID="cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" containerName="maas-api" containerID="cri-o://cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2" gracePeriod=30 Jun 15 02:46:37.719227 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:37.719195 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:38.376428 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.376405 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:46:38.396779 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.396749 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-openshift-service-ca\") pod \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " Jun 15 02:46:38.396944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.396818 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-maas-api-tls\") pod \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " Jun 15 02:46:38.396944 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.396877 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j87jw\" (UniqueName: \"kubernetes.io/projected/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-kube-api-access-j87jw\") pod \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\" (UID: \"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba\") " Jun 15 02:46:38.397265 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.397238 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" (UID: "cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:46:38.399671 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.399617 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-kube-api-access-j87jw" (OuterVolumeSpecName: "kube-api-access-j87jw") pod "cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" (UID: "cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba"). InnerVolumeSpecName "kube-api-access-j87jw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:46:38.400082 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.400061 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" (UID: "cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:46:38.498568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.498499 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-openshift-service-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:46:38.498568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.498526 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-maas-api-tls\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:46:38.498568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:38.498536 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j87jw\" (UniqueName: \"kubernetes.io/projected/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba-kube-api-access-j87jw\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:46:39.110246 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.110207 2559 generic.go:356] "Generic (PLEG): container finished" podID="cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" containerID="cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2" exitCode=0 Jun 15 02:46:39.110246 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.110248 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-c9ff44f6c-29hlh" Jun 15 02:46:39.110511 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.110299 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c9ff44f6c-29hlh" event={"ID":"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba","Type":"ContainerDied","Data":"cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2"} Jun 15 02:46:39.110511 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.110360 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-c9ff44f6c-29hlh" event={"ID":"cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba","Type":"ContainerDied","Data":"43792ef0302f91e264a78424ebbf9f7a0b307fbf47ea4095ace757478c0b560d"} Jun 15 02:46:39.110511 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.110389 2559 scope.go:117] "RemoveContainer" containerID="cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2" Jun 15 02:46:39.119893 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.119872 2559 scope.go:117] "RemoveContainer" containerID="cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2" Jun 15 02:46:39.120170 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:46:39.120151 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2\": container with ID starting with cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2 not found: ID does not exist" containerID="cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2" Jun 15 02:46:39.120237 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.120178 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2"} err="failed to get container status \"cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2\": rpc error: code = NotFound desc = could not find container \"cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2\": container with ID starting with cd416143bd077c49b7922ca3f667835d800abe81382eb592de89ef9811a8ada2 not found: ID does not exist" Jun 15 02:46:39.132614 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.132588 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-c9ff44f6c-29hlh"] Jun 15 02:46:39.138544 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:39.138524 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-c9ff44f6c-29hlh"] Jun 15 02:46:40.086099 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:40.086063 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" path="/var/lib/kubelet/pods/cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba/volumes" Jun 15 02:46:43.431633 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:43.431601 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:48.843158 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:48.843119 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:46:48.944589 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:46:48.944555 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:21.143708 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.143671 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:21.245017 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.244963 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:21.312006 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.311960 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-84b6c86466-dtlk6"] Jun 15 02:47:21.312399 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.312385 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" containerName="maas-api" Jun 15 02:47:21.312459 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.312402 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" containerName="maas-api" Jun 15 02:47:21.312497 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.312489 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cadd5fce-d6d3-41c4-9beb-0ebc6d5ea2ba" containerName="maas-api" Jun 15 02:47:21.315809 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.315794 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.325737 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.325710 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-84b6c86466-dtlk6"] Jun 15 02:47:21.337862 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.337808 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:21.477060 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.477025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vvb2\" (UniqueName: \"kubernetes.io/projected/ee088996-3eff-4a38-bbe1-5af28cfba4dc-kube-api-access-8vvb2\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.477234 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.477074 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee088996-3eff-4a38-bbe1-5af28cfba4dc-openshift-service-ca\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.477277 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.477232 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee088996-3eff-4a38-bbe1-5af28cfba4dc-maas-api-tls\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.578004 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.577947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee088996-3eff-4a38-bbe1-5af28cfba4dc-maas-api-tls\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.578153 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.578037 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vvb2\" (UniqueName: \"kubernetes.io/projected/ee088996-3eff-4a38-bbe1-5af28cfba4dc-kube-api-access-8vvb2\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.578153 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.578091 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee088996-3eff-4a38-bbe1-5af28cfba4dc-openshift-service-ca\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.578704 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.578681 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee088996-3eff-4a38-bbe1-5af28cfba4dc-openshift-service-ca\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.580565 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.580540 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee088996-3eff-4a38-bbe1-5af28cfba4dc-maas-api-tls\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.587619 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.587597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vvb2\" (UniqueName: \"kubernetes.io/projected/ee088996-3eff-4a38-bbe1-5af28cfba4dc-kube-api-access-8vvb2\") pod \"maas-api-84b6c86466-dtlk6\" (UID: \"ee088996-3eff-4a38-bbe1-5af28cfba4dc\") " pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.628602 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.628581 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:21.766356 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.766333 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-84b6c86466-dtlk6"] Jun 15 02:47:21.768316 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:47:21.768291 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee088996_3eff_4a38_bbe1_5af28cfba4dc.slice/crio-115bc0968bd1201a1ead94d00ac9c9656d91a4e0ecd28634046ea8fb76f72c8b WatchSource:0}: Error finding container 115bc0968bd1201a1ead94d00ac9c9656d91a4e0ecd28634046ea8fb76f72c8b: Status 404 returned error can't find the container with id 115bc0968bd1201a1ead94d00ac9c9656d91a4e0ecd28634046ea8fb76f72c8b Jun 15 02:47:21.806983 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.806959 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:21.907939 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:21.907904 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:22.329706 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:22.329614 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-84b6c86466-dtlk6" event={"ID":"ee088996-3eff-4a38-bbe1-5af28cfba4dc","Type":"ContainerStarted","Data":"3b9ae4d96bec28d842b663a17bc406dddfb4fab7b685bb6b39fe1dc92cb3d7f4"} Jun 15 02:47:22.329706 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:22.329680 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-84b6c86466-dtlk6" event={"ID":"ee088996-3eff-4a38-bbe1-5af28cfba4dc","Type":"ContainerStarted","Data":"115bc0968bd1201a1ead94d00ac9c9656d91a4e0ecd28634046ea8fb76f72c8b"} Jun 15 02:47:22.330279 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:22.329734 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:22.346856 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:22.346808 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-84b6c86466-dtlk6" podStartSLOduration=1.076576456 podStartE2EDuration="1.346773878s" totalImagesPullingTime="270.197422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:47:22.345558646 +0000 UTC m=+1132.731481257" watchObservedRunningTime="2026-06-15 02:47:22.346773878 +0000 UTC m=+1132.732696489" Jun 15 02:47:28.348017 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:28.347974 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-84b6c86466-dtlk6" Jun 15 02:47:28.391823 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:28.391788 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-655b5959f7-rcklk"] Jun 15 02:47:28.392050 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:28.392008 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-655b5959f7-rcklk" podUID="1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" containerName="maas-api" containerID="cri-o://b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a" gracePeriod=30 Jun 15 02:47:29.647099 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.647074 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:47:29.747150 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.747060 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2jt8\" (UniqueName: \"kubernetes.io/projected/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-kube-api-access-p2jt8\") pod \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " Jun 15 02:47:29.747150 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.747094 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-openshift-service-ca\") pod \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " Jun 15 02:47:29.747150 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.747131 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-maas-api-tls\") pod \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\" (UID: \"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4\") " Jun 15 02:47:29.747500 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.747477 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" (UID: "1bad20d3-db2a-4fb8-a6fa-7c46b63badc4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:47:29.749263 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.749233 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-kube-api-access-p2jt8" (OuterVolumeSpecName: "kube-api-access-p2jt8") pod "1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" (UID: "1bad20d3-db2a-4fb8-a6fa-7c46b63badc4"). InnerVolumeSpecName "kube-api-access-p2jt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:47:29.749390 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.749366 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" (UID: "1bad20d3-db2a-4fb8-a6fa-7c46b63badc4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:47:29.847851 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.847820 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2jt8\" (UniqueName: \"kubernetes.io/projected/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-kube-api-access-p2jt8\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:47:29.847851 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.847847 2559 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-openshift-service-ca\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:47:29.847851 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:29.847857 2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4-maas-api-tls\") on node \"ip-10-0-140-24.ec2.internal\" DevicePath \"\"" Jun 15 02:47:30.378574 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.378483 2559 generic.go:356] "Generic (PLEG): container finished" podID="1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" containerID="b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a" exitCode=0 Jun 15 02:47:30.378574 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.378530 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-655b5959f7-rcklk" Jun 15 02:47:30.378785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.378568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-655b5959f7-rcklk" event={"ID":"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4","Type":"ContainerDied","Data":"b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a"} Jun 15 02:47:30.378785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.378635 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-655b5959f7-rcklk" event={"ID":"1bad20d3-db2a-4fb8-a6fa-7c46b63badc4","Type":"ContainerDied","Data":"c1485297f768ecfc2c1a6a8bce1296efb4f1e94563c1b50e52611958ae9c9584"} Jun 15 02:47:30.378785 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.378653 2559 scope.go:117] "RemoveContainer" containerID="b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a" Jun 15 02:47:30.387060 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.387043 2559 scope.go:117] "RemoveContainer" containerID="b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a" Jun 15 02:47:30.387306 ip-10-0-140-24 kubenswrapper[2559]: E0615 02:47:30.387290 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a\": container with ID starting with b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a not found: ID does not exist" containerID="b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a" Jun 15 02:47:30.387362 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.387315 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a"} err="failed to get container status \"b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a\": rpc error: code = NotFound desc = could not find container \"b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a\": container with ID starting with b97259052d1cbd08f89b750513fe5e7456fd7c8e7a71701af46bcdf80f2f578a not found: ID does not exist" Jun 15 02:47:30.396568 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.396543 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-655b5959f7-rcklk"] Jun 15 02:47:30.398580 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:30.398562 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-655b5959f7-rcklk"] Jun 15 02:47:32.086577 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:32.086544 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" path="/var/lib/kubelet/pods/1bad20d3-db2a-4fb8-a6fa-7c46b63badc4/volumes" Jun 15 02:47:45.122424 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:45.122394 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:50.954246 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:50.954168 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:56.560181 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:56.560147 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:56.660932 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:56.660897 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:56.760260 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:56.760219 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:56.911735 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:56.911702 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:47:57.015426 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:47:57.015388 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:13.576415 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:13.576373 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:13.674613 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:13.674572 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:13.780190 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:13.780159 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:19.481549 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:19.481513 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:19.583361 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:19.583331 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:27.650791 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:27.650750 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:27.755346 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:27.755313 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:27.848721 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:27.848691 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:27.948400 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:27.948367 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:30.138744 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:30.138716 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:48:30.142688 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:30.142664 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:48:44.525964 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:44.525926 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:44.686628 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:44.686592 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:44.816271 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:44.816193 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:50.437534 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:50.437504 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:48:50.488517 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:48:50.488485 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:49:06.919310 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:06.919283 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-558999765c-5qcsn_793aeaff-3b63-4311-acf3-614a5c2905d4/nginx/0.log" Jun 15 02:49:07.403561 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:07.403474 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-84b6c86466-dtlk6_ee088996-3eff-4a38-bbe1-5af28cfba4dc/maas-api/0.log" Jun 15 02:49:07.568196 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:07.568163 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691525-fq7pm_b76a08de-9c29-4b91-a624-206bb495ebe5/cleanup/0.log" Jun 15 02:49:08.309061 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:08.309033 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785bc74785-zxpcg_5d89bbf9-b149-441d-b968-8f6e17151249/copy-manifests/0.log" Jun 15 02:49:08.315374 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:08.315352 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785bc74785-zxpcg_5d89bbf9-b149-441d-b968-8f6e17151249/manager/0.log" Jun 15 02:49:08.433925 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:08.433890 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mnpsc_b00a76b5-fac6-4650-b950-d96267abe4e9/postgres/0.log" Jun 15 02:49:09.999028 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:09.998977 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vlhg5_6b53a396-32b0-4551-8a6a-d29023d13d17/manager/0.log" Jun 15 02:49:10.379037 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:10.378939 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-px6z7_18078039-543c-40f6-bafc-fc957ab328ac/registry-server/0.log" Jun 15 02:49:11.201384 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:11.201349 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hbh5_4ab1faa1-e59b-4fcd-af82-e05111ab92fb/istio-proxy/0.log" Jun 15 02:49:11.696406 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:11.696370 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/1.log" Jun 15 02:49:12.063426 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:12.063348 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65dd75fbbd-wbt2h_9631d33a-8f79-4f1e-b1f2-80a9137ab308/router/0.log" Jun 15 02:49:17.388647 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:17.388555 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:49:17.444402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:17.444372 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" limit=1024 Jun 15 02:49:20.171218 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:20.171188 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pkxlc_271f66fd-aa03-478a-b5f4-389e9b318d91/global-pull-secret-syncer/0.log" Jun 15 02:49:20.252402 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:20.252362 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j5h7n_20b9ad28-1085-466e-9216-b558186923c4/konnectivity-agent/0.log" Jun 15 02:49:20.337066 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:20.337043 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-24.ec2.internal_872c428ced8b45607624266cca564b27/haproxy/0.log" Jun 15 02:49:24.763333 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:24.763301 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vlhg5_6b53a396-32b0-4551-8a6a-d29023d13d17/manager/0.log" Jun 15 02:49:24.833263 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:24.833186 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-px6z7_18078039-543c-40f6-bafc-fc957ab328ac/registry-server/0.log" Jun 15 02:49:26.877739 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:26.877706 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-pwnjc_904d3d6f-17b0-48d1-870b-835299a7b072/cluster-monitoring-operator/0.log" Jun 15 02:49:26.897827 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:26.897797 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-8bvbg_befd20b5-9cb7-4c0d-977c-f421817b378e/kube-state-metrics/0.log" Jun 15 02:49:26.914387 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:26.914364 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-8bvbg_befd20b5-9cb7-4c0d-977c-f421817b378e/kube-rbac-proxy-main/0.log" Jun 15 02:49:26.934681 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:26.934665 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-8bvbg_befd20b5-9cb7-4c0d-977c-f421817b378e/kube-rbac-proxy-self/0.log" Jun 15 02:49:26.984722 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:26.984701 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-h5vcf_80ad6dc9-b33c-4f59-bbf1-201eb318f9ba/monitoring-plugin/0.log" Jun 15 02:49:27.011175 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.011154 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cr2pz_a839b417-c759-419c-ad89-091ee9de286f/node-exporter/0.log" Jun 15 02:49:27.028722 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.028686 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cr2pz_a839b417-c759-419c-ad89-091ee9de286f/kube-rbac-proxy/0.log" Jun 15 02:49:27.045641 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.045623 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cr2pz_a839b417-c759-419c-ad89-091ee9de286f/init-textfile/0.log" Jun 15 02:49:27.297205 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.297170 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/prometheus/0.log" Jun 15 02:49:27.315433 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.315392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/config-reloader/0.log" Jun 15 02:49:27.333448 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.333416 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/thanos-sidecar/0.log" Jun 15 02:49:27.351902 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.351881 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/kube-rbac-proxy-web/0.log" Jun 15 02:49:27.369916 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.369892 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/kube-rbac-proxy/0.log" Jun 15 02:49:27.388496 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.388478 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/kube-rbac-proxy-thanos/0.log" Jun 15 02:49:27.407329 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.407309 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_88982110-7082-4c09-bf5e-e85e4e779638/init-config-reloader/0.log" Jun 15 02:49:27.614912 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.614838 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f987994b9-zp9lb_a5f4d5b5-e850-482d-8f58-da6b4dec9905/thanos-query/0.log" Jun 15 02:49:27.637881 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.637859 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f987994b9-zp9lb_a5f4d5b5-e850-482d-8f58-da6b4dec9905/kube-rbac-proxy-web/0.log" Jun 15 02:49:27.659086 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.659064 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f987994b9-zp9lb_a5f4d5b5-e850-482d-8f58-da6b4dec9905/kube-rbac-proxy/0.log" Jun 15 02:49:27.690578 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.690560 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f987994b9-zp9lb_a5f4d5b5-e850-482d-8f58-da6b4dec9905/prom-label-proxy/0.log" Jun 15 02:49:27.707428 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.707412 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f987994b9-zp9lb_a5f4d5b5-e850-482d-8f58-da6b4dec9905/kube-rbac-proxy-rules/0.log" Jun 15 02:49:27.730742 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:27.730724 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f987994b9-zp9lb_a5f4d5b5-e850-482d-8f58-da6b4dec9905/kube-rbac-proxy-metrics/0.log" Jun 15 02:49:29.357492 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:29.357466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-766cn_5e600738-ee08-48fe-aba2-14a2b8540111/networking-console-plugin/0.log" Jun 15 02:49:30.543636 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:30.543609 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-9fs7c_e90f45c7-9e12-4579-9e72-98c96463e2c9/download-server/0.log" Jun 15 02:49:31.174871 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.174840 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-p8vsj_a0b84785-254c-4a0c-8e5e-cad8056d6e72/volume-data-source-validator/0.log" Jun 15 02:49:31.550574 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.550498 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt"] Jun 15 02:49:31.551002 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.550947 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" containerName="maas-api" Jun 15 02:49:31.551002 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.550963 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" containerName="maas-api" Jun 15 02:49:31.551090 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.551066 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bad20d3-db2a-4fb8-a6fa-7c46b63badc4" containerName="maas-api" Jun 15 02:49:31.553792 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.553772 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.556748 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.556726 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7twvb\"/\"openshift-service-ca.crt\"" Jun 15 02:49:31.556862 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.556730 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7twvb\"/\"kube-root-ca.crt\"" Jun 15 02:49:31.558003 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.557977 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7twvb\"/\"default-dockercfg-qxpq8\"" Jun 15 02:49:31.564250 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.564226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt"] Jun 15 02:49:31.634512 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.634484 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-lib-modules\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.634644 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.634525 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-proc\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.634644 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.634543 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7rzd\" (UniqueName: \"kubernetes.io/projected/4526914f-a3c2-4be6-8438-88cb18e795b4-kube-api-access-h7rzd\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.634750 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.634638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-podres\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.634750 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.634670 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-sys\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736164 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-lib-modules\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736295 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-proc\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736295 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736249 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-proc\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736295 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7rzd\" (UniqueName: \"kubernetes.io/projected/4526914f-a3c2-4be6-8438-88cb18e795b4-kube-api-access-h7rzd\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-podres\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-sys\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736331 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-lib-modules\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736400 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-sys\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.736456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.736431 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4526914f-a3c2-4be6-8438-88cb18e795b4-podres\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.745778 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.745757 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7rzd\" (UniqueName: \"kubernetes.io/projected/4526914f-a3c2-4be6-8438-88cb18e795b4-kube-api-access-h7rzd\") pod \"perf-node-gather-daemonset-vlhnt\" (UID: \"4526914f-a3c2-4be6-8438-88cb18e795b4\") " pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.864729 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.864651 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:31.999739 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:31.999695 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt"] Jun 15 02:49:32.002143 ip-10-0-140-24 kubenswrapper[2559]: W0615 02:49:32.002116 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4526914f_a3c2_4be6_8438_88cb18e795b4.slice/crio-f860b1831a35faf821ddcb2dfdaae2a592ed446c4cc0a9ffa1a090247ca58fe0 WatchSource:0}: Error finding container f860b1831a35faf821ddcb2dfdaae2a592ed446c4cc0a9ffa1a090247ca58fe0: Status 404 returned error can't find the container with id f860b1831a35faf821ddcb2dfdaae2a592ed446c4cc0a9ffa1a090247ca58fe0 Jun 15 02:49:32.459822 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:32.459786 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bh7cd_707efa2d-6065-4258-98f2-1807dd389882/dns/0.log" Jun 15 02:49:32.476784 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:32.476754 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bh7cd_707efa2d-6065-4258-98f2-1807dd389882/kube-rbac-proxy/0.log" Jun 15 02:49:32.535456 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:32.535434 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-74mjb_409968b6-a03b-4caf-b7df-e03d50603795/dns-node-resolver/0.log" Jun 15 02:49:32.990621 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:32.990587 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" event={"ID":"4526914f-a3c2-4be6-8438-88cb18e795b4","Type":"ContainerStarted","Data":"24b55c26ff1e7ebbf59ff87da4209ca55f10da062cfcae60039c41cf6529e63c"} Jun 15 02:49:32.991032 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:32.990655 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:32.991032 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:32.990683 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" event={"ID":"4526914f-a3c2-4be6-8438-88cb18e795b4","Type":"ContainerStarted","Data":"f860b1831a35faf821ddcb2dfdaae2a592ed446c4cc0a9ffa1a090247ca58fe0"} Jun 15 02:49:33.010654 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:33.010600 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" podStartSLOduration=2.010581594 podStartE2EDuration="2.010581594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:49:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:49:33.008004608 +0000 UTC m=+1263.393927211" watchObservedRunningTime="2026-06-15 02:49:33.010581594 +0000 UTC m=+1263.396504205" Jun 15 02:49:33.122201 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:33.122171 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2g55p_622691a5-4cab-449f-9e46-79aa9c1ce23f/node-ca/0.log" Jun 15 02:49:34.078655 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:34.078626 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hbh5_4ab1faa1-e59b-4fcd-af82-e05111ab92fb/istio-proxy/0.log" Jun 15 02:49:34.207007 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:34.206970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/0.log" Jun 15 02:49:34.218777 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:34.218748 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/1.log" Jun 15 02:49:34.302132 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:34.302104 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65dd75fbbd-wbt2h_9631d33a-8f79-4f1e-b1f2-80a9137ab308/router/0.log" Jun 15 02:49:34.843710 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:34.843680 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dz8b9_cc301e02-5d66-4ee7-8e02-9a3732ac2bab/serve-healthcheck-canary/0.log" Jun 15 02:49:35.357436 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:35.357403 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-tlmrs_71163f29-58d5-4390-be0d-75104fdd2d79/insights-operator/0.log" Jun 15 02:49:35.357800 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:35.357630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-tlmrs_71163f29-58d5-4390-be0d-75104fdd2d79/insights-operator/1.log" Jun 15 02:49:35.375429 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:35.375406 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9dxm_e6082822-d2f3-48c8-8cea-78561525f3a1/kube-rbac-proxy/0.log" Jun 15 02:49:35.397507 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:35.397486 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9dxm_e6082822-d2f3-48c8-8cea-78561525f3a1/exporter/0.log" Jun 15 02:49:35.415348 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:35.415329 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k9dxm_e6082822-d2f3-48c8-8cea-78561525f3a1/extractor/0.log" Jun 15 02:49:37.637429 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:37.637401 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-558999765c-5qcsn_793aeaff-3b63-4311-acf3-614a5c2905d4/nginx/0.log" Jun 15 02:49:37.745006 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:37.744962 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-84b6c86466-dtlk6_ee088996-3eff-4a38-bbe1-5af28cfba4dc/maas-api/0.log" Jun 15 02:49:37.765421 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:37.765397 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691525-fq7pm_b76a08de-9c29-4b91-a624-206bb495ebe5/cleanup/0.log" Jun 15 02:49:38.003665 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:38.003635 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785bc74785-zxpcg_5d89bbf9-b149-441d-b968-8f6e17151249/manager/0.log" Jun 15 02:49:38.021310 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:38.021284 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-785bc74785-zxpcg_5d89bbf9-b149-441d-b968-8f6e17151249/copy-manifests/0.log" Jun 15 02:49:38.043299 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:38.043276 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-mnpsc_b00a76b5-fac6-4650-b950-d96267abe4e9/postgres/0.log" Jun 15 02:49:39.005803 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:39.005779 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7twvb/perf-node-gather-daemonset-vlhnt" Jun 15 02:49:39.523115 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:39.523085 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7d59cb4d96-hlznj_8dd227dc-d718-487e-8bbb-164f6017e74f/manager/0.log" Jun 15 02:49:39.544418 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:39.544392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-szqlx_d4fb802b-c49c-45d6-a36f-fa4f0b8e1d76/openshift-lws-operator/0.log" Jun 15 02:49:45.117021 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:45.116970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-xkcbj_a3faa307-10ac-46cd-926e-213c889b97fe/kube-storage-version-migrator-operator/1.log" Jun 15 02:49:45.117968 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:45.117949 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-xkcbj_a3faa307-10ac-46cd-926e-213c889b97fe/kube-storage-version-migrator-operator/0.log" Jun 15 02:49:45.168894 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:45.168869 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hbh5_4ab1faa1-e59b-4fcd-af82-e05111ab92fb/istio-proxy/0.log" Jun 15 02:49:45.261887 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:45.261852 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/0.log" Jun 15 02:49:45.272660 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:45.272633 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/1.log" Jun 15 02:49:45.341747 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:45.341712 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65dd75fbbd-wbt2h_9631d33a-8f79-4f1e-b1f2-80a9137ab308/router/0.log" Jun 15 02:49:46.355957 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.355927 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5wp2f_e329d7d1-1c4b-42c3-9bd4-04a042d82d13/kube-multus/0.log" Jun 15 02:49:46.384499 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.384469 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hbh5_4ab1faa1-e59b-4fcd-af82-e05111ab92fb/istio-proxy/0.log" Jun 15 02:49:46.472040 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.472014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/0.log" Jun 15 02:49:46.482709 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.482686 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/1.log" Jun 15 02:49:46.546007 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.545970 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65dd75fbbd-wbt2h_9631d33a-8f79-4f1e-b1f2-80a9137ab308/router/0.log" Jun 15 02:49:46.671161 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.671136 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/kube-multus-additional-cni-plugins/0.log" Jun 15 02:49:46.692192 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.692165 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/egress-router-binary-copy/0.log" Jun 15 02:49:46.711168 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.711145 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/cni-plugins/0.log" Jun 15 02:49:46.730163 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.730138 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/bond-cni-plugin/0.log" Jun 15 02:49:46.748736 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.748715 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/routeoverride-cni/0.log" Jun 15 02:49:46.765980 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.765961 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/whereabouts-cni-bincopy/0.log" Jun 15 02:49:46.783523 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.783502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg2lk_5c56b7e5-5839-4895-8676-ed17893e8f47/whereabouts-cni/0.log" Jun 15 02:49:46.932807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.932732 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nx5lh_8852e474-0727-45d4-93c0-67ea29e0fe6a/network-metrics-daemon/0.log" Jun 15 02:49:46.949398 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:46.949373 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nx5lh_8852e474-0727-45d4-93c0-67ea29e0fe6a/kube-rbac-proxy/0.log" Jun 15 02:49:47.855428 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.855400 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-controller/0.log" Jun 15 02:49:47.869807 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.869787 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/1.log" Jun 15 02:49:47.869938 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.869822 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovn-acl-logging/0.log" Jun 15 02:49:47.889686 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.889662 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/kube-rbac-proxy-node/0.log" Jun 15 02:49:47.908098 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.908079 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/kube-rbac-proxy-ovn-metrics/0.log" Jun 15 02:49:47.921958 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.921942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/northd/0.log" Jun 15 02:49:47.940877 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.940854 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/nbdb/0.log" Jun 15 02:49:47.959682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.959664 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/sbdb/0.log" Jun 15 02:49:47.998799 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:47.998772 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h6h8k_a6281af0-9f59-4120-a4cb-4657c20b7a76/ovnkube-controller/0.log" Jun 15 02:49:48.094682 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:48.094657 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hbh5_4ab1faa1-e59b-4fcd-af82-e05111ab92fb/istio-proxy/0.log" Jun 15 02:49:48.191220 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:48.191198 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/0.log" Jun 15 02:49:48.203700 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:48.203678 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-srz2r_4565b91d-f087-4faa-a8a2-1beb66ac73d9/istio-proxy/1.log" Jun 15 02:49:48.264220 ip-10-0-140-24 kubenswrapper[2559]: I0615 02:49:48.264196 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-65dd75fbbd-wbt2h_9631d33a-8f79-4f1e-b1f2-80a9137ab308/router/0.log"