Jun 15 01:55:37.091942 ip-10-0-139-93 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 01:55:37.091957 ip-10-0-139-93 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 01:55:37.091967 ip-10-0-139-93 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 01:55:37.092182 ip-10-0-139-93 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 01:55:47.274331 ip-10-0-139-93 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 01:55:47.274349 ip-10-0-139-93 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c89f4a6a7552471cab03c727e874d4ee -- Jun 15 01:58:05.316873 ip-10-0-139-93 systemd[1]: Starting Kubernetes Kubelet... Jun 15 01:58:05.640797 ip-10-0-139-93 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:58:05.640797 ip-10-0-139-93 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 01:58:05.640797 ip-10-0-139-93 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:58:05.640797 ip-10-0-139-93 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 01:58:05.640797 ip-10-0-139-93 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 01:58:05.642455 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.642370 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 01:58:05.646402 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646384 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:58:05.646402 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646400 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646404 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646408 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646411 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646415 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646417 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646420 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646422 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646427 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646431 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646435 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646444 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646447 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646451 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646455 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646458 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646461 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646464 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646466 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:58:05.646469 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646470 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646473 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646477 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646479 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646482 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646485 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646488 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646491 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646494 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646496 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646498 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646501 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646503 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646506 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646510 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646512 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646515 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646518 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646521 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646523 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:58:05.646945 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646526 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646541 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646544 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646546 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646549 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646551 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646554 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646556 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646559 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646562 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646564 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646567 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646569 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646572 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646575 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646578 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646580 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646583 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646586 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646589 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:58:05.647427 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646592 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646594 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646597 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646600 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646603 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646605 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646608 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646612 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646615 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646618 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646620 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646623 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646625 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646628 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646630 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646633 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646635 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646638 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646640 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:58:05.647927 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646643 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646646 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646649 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646651 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646654 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646656 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646659 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646663 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646665 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646668 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646671 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646674 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646676 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646679 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646681 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646684 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646686 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646688 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646691 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.646694 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:58:05.648389 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647410 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647415 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647419 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647422 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647424 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647428 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647431 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647434 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647437 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647440 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647442 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647445 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647448 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647450 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647453 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647455 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647458 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647461 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647463 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647467 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:58:05.648892 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647470 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647473 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647476 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647478 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647484 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647487 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647490 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647492 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647495 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647498 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647501 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647503 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647507 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647511 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647514 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647518 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647521 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647524 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647526 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:58:05.649391 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647544 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647547 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647549 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647552 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647556 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647559 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647562 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647565 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647567 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647570 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647574 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647577 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647579 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647584 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647587 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647589 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647593 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647597 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647600 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:58:05.649913 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647603 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647606 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647609 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647611 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647614 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647617 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647619 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647622 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647625 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647627 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647629 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647632 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647635 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647637 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647640 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647642 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647645 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647647 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647650 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647653 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:58:05.650392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647655 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647658 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647661 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647663 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647666 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647669 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647672 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647674 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647677 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647679 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647682 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647684 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647687 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647689 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647692 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647695 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647697 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647699 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647702 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:58:05.650985 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.647704 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648113 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648118 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648121 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648124 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648127 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648130 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648133 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648136 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648138 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648141 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648143 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648146 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648148 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648151 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648154 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648157 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648160 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648162 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648165 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:58:05.651457 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648168 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648170 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648173 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648177 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648181 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648184 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648187 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648190 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648193 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648196 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648198 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648202 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648204 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648210 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648212 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648215 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648218 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648220 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648223 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648225 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:58:05.651955 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648228 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648230 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648233 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648236 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648238 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648241 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648243 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648246 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648249 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648252 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648254 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648257 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648259 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648262 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648264 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648267 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648269 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648273 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648275 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648278 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:58:05.652470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648280 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648283 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648285 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648288 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648291 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648296 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648299 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648302 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648306 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648309 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648312 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648314 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648317 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648319 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648322 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648324 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648327 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648333 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648335 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:58:05.652975 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648338 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648340 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648343 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648345 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648348 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648350 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648353 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648355 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648358 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648360 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648363 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648365 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648368 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648371 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648373 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648375 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648378 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648380 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648385 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648387 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:58:05.653433 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.648390 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648462 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648470 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648477 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648481 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648486 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648489 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648493 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648497 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648501 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648505 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648509 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648513 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648516 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648519 2562 flags.go:64] FLAG: --cgroup-root="" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648522 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648525 2562 flags.go:64] FLAG: --client-ca-file="" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648542 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648545 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648549 2562 flags.go:64] FLAG: --cluster-domain="" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648552 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648555 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648558 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648562 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 01:58:05.653971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648566 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648568 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648571 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648575 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648578 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648581 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648584 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648588 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648591 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648595 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648598 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648602 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648604 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648607 2562 flags.go:64] FLAG: --enable-server="true" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648610 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648615 2562 flags.go:64] FLAG: --event-burst="100" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648618 2562 flags.go:64] FLAG: --event-qps="50" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648621 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648625 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648629 2562 flags.go:64] FLAG: --eviction-hard="" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648633 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648636 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648639 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648642 2562 flags.go:64] FLAG: --eviction-soft="" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648645 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 01:58:05.654586 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648648 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648650 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648653 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648656 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648659 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648662 2562 flags.go:64] FLAG: --feature-gates="" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648666 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648669 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648672 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648676 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648679 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648682 2562 flags.go:64] FLAG: --help="false" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648685 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648688 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648691 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648694 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648698 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648701 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648704 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648707 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648710 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648712 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648715 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648718 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 01:58:05.655261 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648721 2562 flags.go:64] FLAG: --kube-reserved="" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648725 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648728 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648732 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648734 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648737 2562 flags.go:64] FLAG: --lock-file="" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648740 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648743 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648746 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648752 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648755 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648757 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648760 2562 flags.go:64] FLAG: --logging-format="text" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648764 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648767 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648770 2562 flags.go:64] FLAG: --manifest-url="" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648773 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648778 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648781 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648785 2562 flags.go:64] FLAG: --max-pods="110" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648788 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648791 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648794 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648797 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648800 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 01:58:05.655888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648803 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648806 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648813 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648816 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648818 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648821 2562 flags.go:64] FLAG: --pod-cidr="" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648824 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648830 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648833 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648837 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648840 2562 flags.go:64] FLAG: --port="10250" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648844 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648847 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7933f06b12c5be8" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648850 2562 flags.go:64] FLAG: --qos-reserved="" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648853 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648856 2562 flags.go:64] FLAG: --register-node="true" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648859 2562 flags.go:64] FLAG: --register-with-taints="" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648863 2562 flags.go:64] FLAG: --registry-burst="10" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648865 2562 flags.go:64] FLAG: --registry-qps="5" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648868 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648871 2562 flags.go:64] FLAG: --reserved-memory="" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648875 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648878 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648881 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648884 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 01:58:05.656493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648887 2562 flags.go:64] FLAG: --runonce="false" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648889 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648892 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648895 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648898 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648901 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648904 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648908 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648911 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648914 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648917 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648920 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648922 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648925 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648928 2562 flags.go:64] FLAG: --system-cgroups="" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648931 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648937 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648940 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648943 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648947 2562 flags.go:64] FLAG: --tls-min-version="" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648949 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648952 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648955 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648958 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648961 2562 flags.go:64] FLAG: --v="2" Jun 15 01:58:05.657127 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648965 2562 flags.go:64] FLAG: --version="false" Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648969 2562 flags.go:64] FLAG: --vmodule="" Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648973 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.648977 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649089 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649094 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649097 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649101 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649104 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649107 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649110 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649113 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649115 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649118 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649121 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649125 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649128 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649131 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649134 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649137 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:58:05.657763 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649139 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649142 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649144 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649150 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649154 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649157 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649159 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649162 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649164 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649167 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649169 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649172 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649175 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649177 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649181 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649184 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649186 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649189 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649191 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:58:05.658392 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649194 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649196 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649199 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649201 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649205 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649207 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649209 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649213 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649215 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649218 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649222 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649225 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649227 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649230 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649232 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649235 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649239 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649242 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649244 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649247 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:58:05.659347 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649249 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649251 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649254 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649257 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649259 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649262 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649264 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649268 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649271 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649273 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649276 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649278 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649281 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649284 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649286 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649289 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649291 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649294 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649296 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:58:05.659916 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649299 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649301 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649304 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649307 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649309 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649312 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649314 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649317 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649319 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649323 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649326 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649329 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649331 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649334 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649336 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649339 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649342 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649344 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649347 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649349 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:58:05.660387 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649353 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649355 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649358 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649360 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.649363 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.649885 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.656427 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.656443 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.657650 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.657657 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657780 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657786 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657790 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657793 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657796 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:58:05.660890 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657800 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657805 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657808 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657811 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657814 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657817 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657819 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657823 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657825 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657828 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657831 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657834 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657836 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657839 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657841 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657844 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657847 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657850 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657853 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657856 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:58:05.661273 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657861 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657864 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657867 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657869 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657872 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657875 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657878 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657880 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657883 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657886 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657888 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657891 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657893 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657897 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657899 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657902 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657904 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657907 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657909 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657912 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:58:05.661789 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657915 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657917 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657920 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657922 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657924 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657927 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657929 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657932 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657935 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657937 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657939 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657942 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657945 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657948 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657950 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657953 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657956 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657960 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657964 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657967 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:58:05.662353 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657970 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657973 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657976 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657979 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657982 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.657984 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658031 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658157 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658166 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658171 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658176 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658181 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658186 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658191 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658196 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658201 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658206 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658215 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658222 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658236 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:58:05.662969 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658242 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658249 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658254 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658259 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658267 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658271 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658276 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658292 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658297 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658302 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658308 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658313 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658323 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658328 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.658338 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:58:05.663506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658775 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658787 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658794 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658799 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658809 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658815 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658823 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658831 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658835 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658839 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658845 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658850 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658862 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658866 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658871 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658875 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658879 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658883 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658888 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 01:58:05.663981 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658892 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658896 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658901 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658905 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658910 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658914 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658924 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658928 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658932 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658937 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658941 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658945 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658949 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658954 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658959 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658963 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658968 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658972 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658977 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658986 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 01:58:05.664470 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658990 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658995 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.658999 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659003 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659007 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659011 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659016 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659020 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659024 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659029 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659034 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659043 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659047 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659051 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659056 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659060 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659065 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659069 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659073 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659077 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 01:58:05.665027 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659084 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659090 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659094 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659104 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659109 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659114 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659119 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659124 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659129 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659134 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659138 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659144 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659149 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659154 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659159 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659164 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659173 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659177 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659182 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659187 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 01:58:05.665834 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659192 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659196 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659201 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659206 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659211 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659218 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659225 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659229 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659239 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659244 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659248 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659253 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659257 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659261 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659266 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659270 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659274 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659278 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659283 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 01:58:05.666506 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:05.659288 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.659297 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.659722 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.661698 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.662899 2562 server.go:1019] "Starting client certificate rotation" Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.663021 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.663699 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.665197 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:58:05.667122 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.666341 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 01:58:05.673804 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.673788 2562 log.go:25] "Validated CRI v1 runtime API" Jun 15 01:58:05.676490 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.676470 2562 log.go:25] "Validated CRI v1 image API" Jun 15 01:58:05.677291 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.677279 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 01:58:05.680943 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.680920 2562 fs.go:135] Filesystem UUIDs: map[2763dc5d-7de3-4b2c-9996-ec23b5dad3a6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ca9a870c-8229-4353-9727-f22667a17e0c:/dev/nvme0n1p3] Jun 15 01:58:05.680991 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.680943 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 01:58:05.686721 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.686605 2562 manager.go:216] Machine: {Timestamp:2026-06-15 01:58:05.685400927 +0000 UTC m=+0.269292719 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099749 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212d022310b0fe80e4562c44aa7097 SystemUUID:ec212d02-2310-b0fe-80e4-562c44aa7097 BootID:c89f4a6a-7552-471c-ab03-c727e874d4ee Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:23:e4:e0:2e:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:23:e4:e0:2e:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:76:66:5b:d6:43:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 01:58:05.686721 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.686718 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 01:58:05.686838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.686803 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 01:58:05.687901 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.687876 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 01:58:05.688115 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.687903 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 01:58:05.688592 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.688582 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 01:58:05.688625 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.688595 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 01:58:05.688625 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.688602 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:58:05.689130 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.689120 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 01:58:05.690337 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.690327 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 01:58:05.691138 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.691122 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:58:05.694864 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.694852 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:58:05.694991 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.694981 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 01:58:05.695027 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695013 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 15 01:58:05.695058 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695043 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 01:58:05.695085 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695059 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 01:58:05.695112 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695098 2562 kubelet.go:398] "Adding apiserver pod source" Jun 15 01:58:05.695112 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695107 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 01:58:05.695647 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695624 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:58:05.695763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.695654 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 01:58:05.697676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.697657 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 01:58:05.699277 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.699262 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 01:58:05.699322 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.699295 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 01:58:05.699524 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.699505 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 01:58:05.699524 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.699555 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 01:58:05.699682 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.699569 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 01:58:05.700012 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.699703 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 01:58:05.700082 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700024 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 01:58:05.700082 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700074 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 01:58:05.700167 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700088 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 01:58:05.700167 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700097 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 01:58:05.700167 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700108 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 01:58:05.700167 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700117 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 01:58:05.700167 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700130 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 01:58:05.700167 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700146 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 01:58:05.700772 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700751 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 01:58:05.700856 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.700775 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 01:58:05.704623 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.704610 2562 server.go:1268] "Started kubelet" Jun 15 01:58:05.704747 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.704711 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 01:58:05.704810 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.704770 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 01:58:05.705479 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.705444 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 01:58:05.705560 ip-10-0-139-93 systemd[1]: Started Kubernetes Kubelet. Jun 15 01:58:05.706708 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.706690 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 01:58:05.707057 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.707033 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-93.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 01:58:05.707151 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.707099 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 01:58:05.707356 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.707332 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 01:58:05.707569 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.707558 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 15 01:58:05.710805 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.710788 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 01:58:05.711050 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711030 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 01:58:05.711133 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711049 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 01:58:05.711187 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.711115 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:05.711595 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711578 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 01:58:05.711676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711597 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 01:58:05.711676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711614 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 01:58:05.711808 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711716 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 15 01:58:05.711808 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711725 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 15 01:58:05.711808 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711800 2562 factory.go:55] Registering systemd factory Jun 15 01:58:05.711959 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.711816 2562 factory.go:223] Registration of the systemd container factory successfully Jun 15 01:58:05.712082 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.712048 2562 factory.go:153] Registering CRI-O factory Jun 15 01:58:05.712082 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.712070 2562 factory.go:223] Registration of the crio container factory successfully Jun 15 01:58:05.712217 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.712123 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 01:58:05.712217 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.712146 2562 factory.go:103] Registering Raw factory Jun 15 01:58:05.712217 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.712163 2562 manager.go:1196] Started watching for new ooms in manager Jun 15 01:58:05.712849 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.712822 2562 manager.go:349] Starting recovery of all containers Jun 15 01:58:05.712961 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.712064 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-93.ec2.internal.18b91e855acc4d5d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-93.ec2.internal,UID:ip-10-0-139-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-93.ec2.internal,},FirstTimestamp:2026-06-15 01:58:05.704564061 +0000 UTC m=+0.288455854,LastTimestamp:2026-06-15 01:58:05.704564061 +0000 UTC m=+0.288455854,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-93.ec2.internal,}" Jun 15 01:58:05.716785 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.716762 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4l2xz" Jun 15 01:58:05.718467 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.718428 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 01:58:05.718467 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.718431 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 01:58:05.723412 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.723250 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4l2xz" Jun 15 01:58:05.724274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.724257 2562 manager.go:354] Recovery completed Jun 15 01:58:05.726086 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.726062 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 15 01:58:05.730502 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.730490 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.732563 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.732522 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.732709 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.732575 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.732709 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.732587 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.733147 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.733132 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 01:58:05.733147 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.733146 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 01:58:05.733314 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.733164 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 15 01:58:05.733314 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.733163 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.734926 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.734102 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.734926 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.734129 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.734926 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.734144 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.734926 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.734696 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-93.ec2.internal.18b91e855c777fc2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-93.ec2.internal,UID:ip-10-0-139-93.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-93.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-93.ec2.internal,},FirstTimestamp:2026-06-15 01:58:05.732560834 +0000 UTC m=+0.316452627,LastTimestamp:2026-06-15 01:58:05.732560834 +0000 UTC m=+0.316452627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-93.ec2.internal,}" Jun 15 01:58:05.736048 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.736035 2562 policy_none.go:49] "None policy: Start" Jun 15 01:58:05.736048 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.736051 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 01:58:05.736144 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.736062 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 01:58:05.738029 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.738018 2562 policy_none.go:47] "Start" Jun 15 01:58:05.775268 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775243 2562 manager.go:337] "Starting Device Plugin manager" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.775299 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775314 2562 server.go:87] "Starting device plugin registration server" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775635 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775653 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775749 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775844 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.775854 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.777057 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.777103 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.779505 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.780805 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.780842 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.780869 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.780907 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 01:58:05.794269 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.782707 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:58:05.875821 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.875779 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.877506 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.877483 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.877587 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.877514 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.877587 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.877527 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.877587 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.877574 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.881556 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.881524 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal"] Jun 15 01:58:05.881609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.881600 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.882485 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.882469 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.882522 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.882505 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.882522 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.882520 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.884899 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.884888 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.885014 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.884998 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.885079 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.885030 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.885079 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.885031 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.885079 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.885051 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-93.ec2.internal\": node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:05.887354 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.887337 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.887500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.887362 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.887500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.887376 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.887500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.887385 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.887500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.887410 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.887500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.887425 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.889682 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.889666 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.889765 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.889691 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 01:58:05.891841 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.891789 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientMemory" Jun 15 01:58:05.891841 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.891817 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 01:58:05.891841 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.891826 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeHasSufficientPID" Jun 15 01:58:05.901215 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.901193 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:05.912427 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.912407 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-93.ec2.internal\" not found" node="ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.913165 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.913140 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd979c5062d272903f09f604fc27e5f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"dd979c5062d272903f09f604fc27e5f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.913277 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.913169 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd979c5062d272903f09f604fc27e5f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"dd979c5062d272903f09f604fc27e5f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.913277 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:05.913198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/578f1ddaea42b73ed5919bd0640b2e20-config\") pod \"kube-apiserver-proxy-ip-10-0-139-93.ec2.internal\" (UID: \"578f1ddaea42b73ed5919bd0640b2e20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jun 15 01:58:05.916822 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:05.916803 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-93.ec2.internal\" not found" node="ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.002244 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.002208 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.014177 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.014155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd979c5062d272903f09f604fc27e5f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"dd979c5062d272903f09f604fc27e5f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.014246 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.014182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/578f1ddaea42b73ed5919bd0640b2e20-config\") pod \"kube-apiserver-proxy-ip-10-0-139-93.ec2.internal\" (UID: \"578f1ddaea42b73ed5919bd0640b2e20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.014246 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.014201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd979c5062d272903f09f604fc27e5f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"dd979c5062d272903f09f604fc27e5f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.014326 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.014259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/578f1ddaea42b73ed5919bd0640b2e20-config\") pod \"kube-apiserver-proxy-ip-10-0-139-93.ec2.internal\" (UID: \"578f1ddaea42b73ed5919bd0640b2e20\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.014326 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.014282 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dd979c5062d272903f09f604fc27e5f6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"dd979c5062d272903f09f604fc27e5f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.014386 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.014333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dd979c5062d272903f09f604fc27e5f6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal\" (UID: \"dd979c5062d272903f09f604fc27e5f6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.103372 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.103330 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.204191 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.204134 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.214477 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.214456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.220612 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.220594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jun 15 01:58:06.305072 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.305031 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.405597 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.405563 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.506152 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.506063 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.606733 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.606698 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.662121 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.662093 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 01:58:06.662789 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.662257 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 01:58:06.707689 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.707652 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.728681 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.728645 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 01:53:05 +0000 UTC" deadline="2028-01-31 22:45:50.347552445 +0000 UTC" Jun 15 01:58:06.728681 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.728674 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14300h47m43.618881202s" Jun 15 01:58:06.737984 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:06.737942 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578f1ddaea42b73ed5919bd0640b2e20.slice/crio-680fa15d94eca22174bcc51e530d508b630e55542827359da7b7ea135fe65366 WatchSource:0}: Error finding container 680fa15d94eca22174bcc51e530d508b630e55542827359da7b7ea135fe65366: Status 404 returned error can't find the container with id 680fa15d94eca22174bcc51e530d508b630e55542827359da7b7ea135fe65366 Jun 15 01:58:06.738157 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:06.738137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd979c5062d272903f09f604fc27e5f6.slice/crio-7fa27ca73a20faaf334f8843dc3723b92ffc88249b56c00c7259d172d2debe42 WatchSource:0}: Error finding container 7fa27ca73a20faaf334f8843dc3723b92ffc88249b56c00c7259d172d2debe42: Status 404 returned error can't find the container with id 7fa27ca73a20faaf334f8843dc3723b92ffc88249b56c00c7259d172d2debe42 Jun 15 01:58:06.742058 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.742043 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 01:58:06.751606 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.751581 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:58:06.784981 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.784870 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" event={"ID":"578f1ddaea42b73ed5919bd0640b2e20","Type":"ContainerStarted","Data":"680fa15d94eca22174bcc51e530d508b630e55542827359da7b7ea135fe65366"} Jun 15 01:58:06.785812 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:06.785784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"dd979c5062d272903f09f604fc27e5f6","Type":"ContainerStarted","Data":"7fa27ca73a20faaf334f8843dc3723b92ffc88249b56c00c7259d172d2debe42"} Jun 15 01:58:06.807985 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.807955 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:06.908490 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:06.908456 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:07.009012 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.008985 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:07.109508 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.109473 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:07.210381 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.210342 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-93.ec2.internal\" not found" Jun 15 01:58:07.261072 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.261040 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:58:07.310324 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.310293 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:58:07.311205 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.311184 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" Jun 15 01:58:07.323354 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.323327 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:58:07.324212 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.324189 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" Jun 15 01:58:07.332258 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.332230 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 01:58:07.695500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.695452 2562 apiserver.go:52] "Watching apiserver" Jun 15 01:58:07.706003 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.705974 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 01:58:07.706382 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.706361 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-k4qcm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal","openshift-multus/multus-rjqhj","openshift-multus/network-metrics-daemon-lxtkn","openshift-network-diagnostics/network-check-target-8k9v2","openshift-ovn-kubernetes/ovnkube-node-bql95","kube-system/global-pull-secret-syncer-x9kcc","kube-system/konnectivity-agent-hj85b","openshift-dns/node-resolver-wjwwn","openshift-image-registry/node-ca-s7ntl","openshift-multus/multus-additional-cni-plugins-hb74t","openshift-network-operator/iptables-alerter-454pb","kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6"] Jun 15 01:58:07.708857 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.708827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.711163 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.711038 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.711279 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.711195 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 01:58:07.711279 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.711194 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.711279 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.711266 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-grc8g\"" Jun 15 01:58:07.711414 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.711375 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 01:58:07.711665 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.711641 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.713212 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8qstr\"" Jun 15 01:58:07.713311 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713258 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.713610 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713592 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.713689 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713647 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 01:58:07.713870 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713853 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 01:58:07.714000 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713901 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.714000 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.713958 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 01:58:07.715133 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.715114 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 01:58:07.715762 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.715463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:07.715762 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.715549 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:07.715762 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.715567 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lssz7\"" Jun 15 01:58:07.717821 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.717805 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:07.717918 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.717862 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:07.719986 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.719969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.722205 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.722185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.722310 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.722293 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sq7b6\"" Jun 15 01:58:07.722368 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.722337 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.722368 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.722344 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.723600 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.723506 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 01:58:07.724336 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724315 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.724428 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724347 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-54zvg\"" Jun 15 01:58:07.724428 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-kubelet\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724555 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-cni-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724555 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-netns\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724555 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724495 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-cni-multus\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724555 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724520 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499434fd-8161-4177-8ea1-34f897544ef1-cni-binary-copy\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-cni-bin\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-cni-binary-copy\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-system-cni-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724643 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-conf-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a23f5598-3393-4ac3-8713-572956063835-serviceca\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.724763 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69fw\" (UniqueName: \"kubernetes.io/projected/7009d4dd-06b3-4f23-be79-ce339b4bd492-kube-api-access-v69fw\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-cnibin\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-k8s-cni-cncf-io\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499434fd-8161-4177-8ea1-34f897544ef1-multus-daemon-config\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724835 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2674w\" (UniqueName: \"kubernetes.io/projected/499434fd-8161-4177-8ea1-34f897544ef1-kube-api-access-2674w\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-os-release\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-multus-certs\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-etc-kubernetes\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23f5598-3393-4ac3-8713-572956063835-host\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.724989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5zm4\" (UniqueName: \"kubernetes.io/projected/a23f5598-3393-4ac3-8713-572956063835-kube-api-access-j5zm4\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-system-cni-dir\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725033 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-os-release\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-cnibin\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.725135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-socket-dir-parent\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725766 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-hostroot\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.725766 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.725238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.726774 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.726755 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 01:58:07.726997 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.726983 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6fz85\"" Jun 15 01:58:07.727285 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.727274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.727337 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.727318 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:07.727778 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.727758 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 01:58:07.727860 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.727766 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 01:58:07.727960 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.727940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.728017 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.728003 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.728068 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.728044 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 01:58:07.729497 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.729480 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.731663 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.731640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 01:58:07.731759 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.731730 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.731820 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.731730 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b8kr8\"" Jun 15 01:58:07.731868 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.731822 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.732566 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.732526 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.734391 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.734371 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.735336 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.735058 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 01:58:07.735747 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.735725 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 01:58:07.736004 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.735988 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gm8fn\"" Jun 15 01:58:07.736764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.736745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 01:58:07.737144 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.737123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lsmc6\"" Jun 15 01:58:07.737520 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.737498 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8d5v5" Jun 15 01:58:07.737633 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.737593 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 01:58:07.737698 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.737595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 01:58:07.744748 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.744724 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8d5v5" Jun 15 01:58:07.812639 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.812608 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 01:58:07.825416 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-env-overrides\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.825416 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovnkube-script-lib\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.825676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a23f5598-3393-4ac3-8713-572956063835-serviceca\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.825676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69fw\" (UniqueName: \"kubernetes.io/projected/7009d4dd-06b3-4f23-be79-ce339b4bd492-kube-api-access-v69fw\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.825676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-cnibin\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.825676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499434fd-8161-4177-8ea1-34f897544ef1-multus-daemon-config\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.825676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-cnibin\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.825676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825648 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1083a323-51f0-4221-bbce-2c7973b7c1a1-agent-certs\") pod \"konnectivity-agent-hj85b\" (UID: \"1083a323-51f0-4221-bbce-2c7973b7c1a1\") " pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/624fe62d-eaad-433f-add3-8e090b7e1b38-hosts-file\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-log-socket\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovn-node-metrics-cert\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-multus-certs\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k877\" (UniqueName: \"kubernetes.io/projected/67ff0471-0c24-4354-a459-310b8c44af0c-kube-api-access-8k877\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-multus-certs\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1083a323-51f0-4221-bbce-2c7973b7c1a1-konnectivity-ca\") pod \"konnectivity-agent-hj85b\" (UID: \"1083a323-51f0-4221-bbce-2c7973b7c1a1\") " pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-kubelet\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-etc-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.825946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-cni-netd\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.825981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-device-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23f5598-3393-4ac3-8713-572956063835-host\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5zm4\" (UniqueName: \"kubernetes.io/projected/a23f5598-3393-4ac3-8713-572956063835-kube-api-access-j5zm4\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-system-cni-dir\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a23f5598-3393-4ac3-8713-572956063835-host\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826109 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkc6r\" (UniqueName: \"kubernetes.io/projected/780b4c5a-d475-46c1-80b9-939680e0c142-kube-api-access-zkc6r\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-system-cni-dir\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826171 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a23f5598-3393-4ac3-8713-572956063835-serviceca\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826173 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-cnibin\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826212 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-cnibin\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-socket-dir-parent\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826256 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/499434fd-8161-4177-8ea1-34f897544ef1-multus-daemon-config\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe74fdac-c36b-4513-ab6b-a73ae892e085-kubelet-config\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-node-log\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826378 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-socket-dir-parent\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.826418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71e58f02-6f96-4006-be1f-ce7deed0d675-iptables-alerter-script\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-kubelet\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-kubelet\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-kubernetes\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qz5p\" (UniqueName: \"kubernetes.io/projected/624fe62d-eaad-433f-add3-8e090b7e1b38-kube-api-access-4qz5p\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826608 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-cni-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-cni-multus\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826659 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysconfig\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826679 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-cni-multus\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-host\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-cni-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe74fdac-c36b-4513-ab6b-a73ae892e085-dbus\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71e58f02-6f96-4006-be1f-ce7deed0d675-host-slash\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826806 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx7kh\" (UniqueName: \"kubernetes.io/projected/71e58f02-6f96-4006-be1f-ce7deed0d675-kube-api-access-cx7kh\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-registration-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499434fd-8161-4177-8ea1-34f897544ef1-cni-binary-copy\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysctl-d\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.826966 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr7rv\" (UniqueName: \"kubernetes.io/projected/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-kube-api-access-zr7rv\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-run-netns\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovnkube-config\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-cni-binary-copy\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-system-cni-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-systemd\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827207 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-k8s-cni-cncf-io\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2674w\" (UniqueName: \"kubernetes.io/projected/499434fd-8161-4177-8ea1-34f897544ef1-kube-api-access-2674w\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-sys\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/499434fd-8161-4177-8ea1-34f897544ef1-cni-binary-copy\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827325 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-system-cni-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-var-lib-kubelet\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-cni-binary-copy\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827326 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-k8s-cni-cncf-io\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.827974 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-os-release\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7009d4dd-06b3-4f23-be79-ce339b4bd492-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-etc-kubernetes\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-cni-bin\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmgb2\" (UniqueName: \"kubernetes.io/projected/167e163e-9658-4668-8d8e-5bc3b21e94b5-kube-api-access-hmgb2\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-sys-fs\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827861 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-etc-kubernetes\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-os-release\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-os-release\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-run\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.827974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-hostroot\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-hostroot\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-os-release\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysctl-conf\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828087 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-systemd\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.828644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-tmp\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828131 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-systemd-units\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7009d4dd-06b3-4f23-be79-ce339b4bd492-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828160 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624fe62d-eaad-433f-add3-8e090b7e1b38-tmp-dir\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-netns\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-run-netns\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-ovn\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-socket-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-cni-bin\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-modprobe-d\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-host-var-lib-cni-bin\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828415 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-tuned\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.829188 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.829755 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.829755 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828482 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-conf-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.829755 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/499434fd-8161-4177-8ea1-34f897544ef1-multus-conf-dir\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.829755 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828516 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-lib-modules\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.829755 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-slash\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.829755 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.828576 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-var-lib-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.832037 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.832016 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 01:58:07.835418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.835392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69fw\" (UniqueName: \"kubernetes.io/projected/7009d4dd-06b3-4f23-be79-ce339b4bd492-kube-api-access-v69fw\") pod \"multus-additional-cni-plugins-hb74t\" (UID: \"7009d4dd-06b3-4f23-be79-ce339b4bd492\") " pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:07.835418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.835414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2674w\" (UniqueName: \"kubernetes.io/projected/499434fd-8161-4177-8ea1-34f897544ef1-kube-api-access-2674w\") pod \"multus-rjqhj\" (UID: \"499434fd-8161-4177-8ea1-34f897544ef1\") " pod="openshift-multus/multus-rjqhj" Jun 15 01:58:07.835592 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.835472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5zm4\" (UniqueName: \"kubernetes.io/projected/a23f5598-3393-4ac3-8713-572956063835-kube-api-access-j5zm4\") pod \"node-ca-s7ntl\" (UID: \"a23f5598-3393-4ac3-8713-572956063835\") " pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:07.929414 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-kubernetes\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qz5p\" (UniqueName: \"kubernetes.io/projected/624fe62d-eaad-433f-add3-8e090b7e1b38-kube-api-access-4qz5p\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.929609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysconfig\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929520 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysconfig\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-kubernetes\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-host\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe74fdac-c36b-4513-ab6b-a73ae892e085-dbus\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71e58f02-6f96-4006-be1f-ce7deed0d675-host-slash\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx7kh\" (UniqueName: \"kubernetes.io/projected/71e58f02-6f96-4006-be1f-ce7deed0d675-kube-api-access-cx7kh\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-host\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-registration-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysctl-d\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr7rv\" (UniqueName: \"kubernetes.io/projected/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-kube-api-access-zr7rv\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71e58f02-6f96-4006-be1f-ce7deed0d675-host-slash\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-run-netns\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovnkube-config\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929794 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-registration-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-systemd\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fe74fdac-c36b-4513-ab6b-a73ae892e085-dbus\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-sys\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929837 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-run-netns\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.929867 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-systemd\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-sys\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929901 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-var-lib-kubelet\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-cni-bin\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysctl-d\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929947 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-var-lib-kubelet\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.929957 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmgb2\" (UniqueName: \"kubernetes.io/projected/167e163e-9658-4668-8d8e-5bc3b21e94b5-kube-api-access-hmgb2\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-sys-fs\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-run\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysctl-conf\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930125 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-cni-bin\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930138 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-sys-fs\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930147 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-run\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930183 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-systemd\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-tmp\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-sysctl-conf\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-systemd-units\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-systemd\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.930630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-systemd-units\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624fe62d-eaad-433f-add3-8e090b7e1b38-tmp-dir\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.930346 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-ovn\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovnkube-config\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-ovn\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.930432 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:08.430392374 +0000 UTC m=+3.014284172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-socket-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-modprobe-d\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930600 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/624fe62d-eaad-433f-add3-8e090b7e1b38-tmp-dir\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.930610 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-tuned\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.931468 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930615 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-socket-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930644 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.930668 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:58:08.430653069 +0000 UTC m=+3.014544863 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-run-ovn-kubernetes\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-lib-modules\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-modprobe-d\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-slash\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-slash\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-var-lib-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930836 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-lib-modules\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-env-overrides\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovnkube-script-lib\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1083a323-51f0-4221-bbce-2c7973b7c1a1-agent-certs\") pod \"konnectivity-agent-hj85b\" (UID: \"1083a323-51f0-4221-bbce-2c7973b7c1a1\") " pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-var-lib-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932215 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.930936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/624fe62d-eaad-433f-add3-8e090b7e1b38-hosts-file\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/624fe62d-eaad-433f-add3-8e090b7e1b38-hosts-file\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-log-socket\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931058 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-log-socket\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931061 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovn-node-metrics-cert\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k877\" (UniqueName: \"kubernetes.io/projected/67ff0471-0c24-4354-a459-310b8c44af0c-kube-api-access-8k877\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1083a323-51f0-4221-bbce-2c7973b7c1a1-konnectivity-ca\") pod \"konnectivity-agent-hj85b\" (UID: \"1083a323-51f0-4221-bbce-2c7973b7c1a1\") " pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-kubelet\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-etc-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-cni-netd\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931208 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-device-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-env-overrides\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-device-dir\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-etc-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-cni-netd\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-host-kubelet\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931431 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovnkube-script-lib\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.932949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkc6r\" (UniqueName: \"kubernetes.io/projected/780b4c5a-d475-46c1-80b9-939680e0c142-kube-api-access-zkc6r\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe74fdac-c36b-4513-ab6b-a73ae892e085-kubelet-config\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-node-log\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71e58f02-6f96-4006-be1f-ce7deed0d675-iptables-alerter-script\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-run-openvswitch\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1083a323-51f0-4221-bbce-2c7973b7c1a1-konnectivity-ca\") pod \"konnectivity-agent-hj85b\" (UID: \"1083a323-51f0-4221-bbce-2c7973b7c1a1\") " pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931743 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fe74fdac-c36b-4513-ab6b-a73ae892e085-kubelet-config\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931794 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/167e163e-9658-4668-8d8e-5bc3b21e94b5-node-log\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.931832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/780b4c5a-d475-46c1-80b9-939680e0c142-etc-selinux\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.932197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71e58f02-6f96-4006-be1f-ce7deed0d675-iptables-alerter-script\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.932891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-tmp\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.933838 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.933069 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-etc-tuned\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.934478 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.934083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1083a323-51f0-4221-bbce-2c7973b7c1a1-agent-certs\") pod \"konnectivity-agent-hj85b\" (UID: \"1083a323-51f0-4221-bbce-2c7973b7c1a1\") " pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:07.934478 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.934257 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/167e163e-9658-4668-8d8e-5bc3b21e94b5-ovn-node-metrics-cert\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.936679 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.936657 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:07.936922 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.936682 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:07.936922 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.936695 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:07.936922 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:07.936756 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:08.436741386 +0000 UTC m=+3.020633172 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:07.938357 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.938309 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmgb2\" (UniqueName: \"kubernetes.io/projected/167e163e-9658-4668-8d8e-5bc3b21e94b5-kube-api-access-hmgb2\") pod \"ovnkube-node-bql95\" (UID: \"167e163e-9658-4668-8d8e-5bc3b21e94b5\") " pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:07.939161 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.939088 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx7kh\" (UniqueName: \"kubernetes.io/projected/71e58f02-6f96-4006-be1f-ce7deed0d675-kube-api-access-cx7kh\") pod \"iptables-alerter-454pb\" (UID: \"71e58f02-6f96-4006-be1f-ce7deed0d675\") " pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:07.939161 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.939128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr7rv\" (UniqueName: \"kubernetes.io/projected/42b6f6dd-987d-4e3c-a695-5fafb49fa23b-kube-api-access-zr7rv\") pod \"tuned-k4qcm\" (UID: \"42b6f6dd-987d-4e3c-a695-5fafb49fa23b\") " pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:07.939930 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.939906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkc6r\" (UniqueName: \"kubernetes.io/projected/780b4c5a-d475-46c1-80b9-939680e0c142-kube-api-access-zkc6r\") pod \"aws-ebs-csi-driver-node-tbcd6\" (UID: \"780b4c5a-d475-46c1-80b9-939680e0c142\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:07.940253 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.940231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k877\" (UniqueName: \"kubernetes.io/projected/67ff0471-0c24-4354-a459-310b8c44af0c-kube-api-access-8k877\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:07.940650 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:07.940629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qz5p\" (UniqueName: \"kubernetes.io/projected/624fe62d-eaad-433f-add3-8e090b7e1b38-kube-api-access-4qz5p\") pod \"node-resolver-wjwwn\" (UID: \"624fe62d-eaad-433f-add3-8e090b7e1b38\") " pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:08.019816 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.019737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s7ntl" Jun 15 01:58:08.027615 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.027589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hb74t" Jun 15 01:58:08.033323 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.033301 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 01:58:08.039206 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.039185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rjqhj" Jun 15 01:58:08.045000 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.044971 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" Jun 15 01:58:08.051662 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.051642 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wjwwn" Jun 15 01:58:08.059394 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.059374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:08.067075 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.067058 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-454pb" Jun 15 01:58:08.074710 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.074690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:08.080374 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.080355 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" Jun 15 01:58:08.435358 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.435321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:08.435549 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.435387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:08.435549 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.435434 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:08.435549 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.435486 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:08.435549 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.435512 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:09.435490488 +0000 UTC m=+4.019382287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:08.435549 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.435550 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:58:09.43552258 +0000 UTC m=+4.019414361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:08.536092 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.536060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:08.536276 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.536239 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:08.536276 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.536262 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:08.536276 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.536273 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:08.536426 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:08.536341 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:09.536322236 +0000 UTC m=+4.120214036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:08.659769 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.659744 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7009d4dd_06b3_4f23_be79_ce339b4bd492.slice/crio-8c071de69f6ba387a448066ba4cb7dcb6e7239f699c20eb203f23c49f5667c72 WatchSource:0}: Error finding container 8c071de69f6ba387a448066ba4cb7dcb6e7239f699c20eb203f23c49f5667c72: Status 404 returned error can't find the container with id 8c071de69f6ba387a448066ba4cb7dcb6e7239f699c20eb203f23c49f5667c72 Jun 15 01:58:08.661081 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.660980 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624fe62d_eaad_433f_add3_8e090b7e1b38.slice/crio-7b3e73fe806e7dd3f05be149809329f10403067ce613fae6968807b1a126ef5a WatchSource:0}: Error finding container 7b3e73fe806e7dd3f05be149809329f10403067ce613fae6968807b1a126ef5a: Status 404 returned error can't find the container with id 7b3e73fe806e7dd3f05be149809329f10403067ce613fae6968807b1a126ef5a Jun 15 01:58:08.665152 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.665125 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b6f6dd_987d_4e3c_a695_5fafb49fa23b.slice/crio-292a7a17985be96d2d4d7e98a754cd9083f14a2910a87f1f2f85939e69d9740f WatchSource:0}: Error finding container 292a7a17985be96d2d4d7e98a754cd9083f14a2910a87f1f2f85939e69d9740f: Status 404 returned error can't find the container with id 292a7a17985be96d2d4d7e98a754cd9083f14a2910a87f1f2f85939e69d9740f Jun 15 01:58:08.665573 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.665526 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167e163e_9658_4668_8d8e_5bc3b21e94b5.slice/crio-158e85d4f6d22b87d854df9621b8692f5a4103caaf1f6d22dd732880ca25c616 WatchSource:0}: Error finding container 158e85d4f6d22b87d854df9621b8692f5a4103caaf1f6d22dd732880ca25c616: Status 404 returned error can't find the container with id 158e85d4f6d22b87d854df9621b8692f5a4103caaf1f6d22dd732880ca25c616 Jun 15 01:58:08.666956 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.666879 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod499434fd_8161_4177_8ea1_34f897544ef1.slice/crio-b3400966ad55025ed4239bb2751411032da551aa5029b69663f79c7c4b1b6be8 WatchSource:0}: Error finding container b3400966ad55025ed4239bb2751411032da551aa5029b69663f79c7c4b1b6be8: Status 404 returned error can't find the container with id b3400966ad55025ed4239bb2751411032da551aa5029b69663f79c7c4b1b6be8 Jun 15 01:58:08.668324 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.668306 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1083a323_51f0_4221_bbce_2c7973b7c1a1.slice/crio-01c83eb9f0db472ec17b833d100479fe3ca0714b5885bf04a9cc1494562224ee WatchSource:0}: Error finding container 01c83eb9f0db472ec17b833d100479fe3ca0714b5885bf04a9cc1494562224ee: Status 404 returned error can't find the container with id 01c83eb9f0db472ec17b833d100479fe3ca0714b5885bf04a9cc1494562224ee Jun 15 01:58:08.668484 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.668467 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780b4c5a_d475_46c1_80b9_939680e0c142.slice/crio-b6931e83f1b2562e9aa8ea7e6238e148bee20bdafbd59994d25acf58ba08308f WatchSource:0}: Error finding container b6931e83f1b2562e9aa8ea7e6238e148bee20bdafbd59994d25acf58ba08308f: Status 404 returned error can't find the container with id b6931e83f1b2562e9aa8ea7e6238e148bee20bdafbd59994d25acf58ba08308f Jun 15 01:58:08.670656 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.670325 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e58f02_6f96_4006_be1f_ce7deed0d675.slice/crio-78d0656209180964e0b4485ce59ccb801588b1678be0ef57e350531842955d52 WatchSource:0}: Error finding container 78d0656209180964e0b4485ce59ccb801588b1678be0ef57e350531842955d52: Status 404 returned error can't find the container with id 78d0656209180964e0b4485ce59ccb801588b1678be0ef57e350531842955d52 Jun 15 01:58:08.670884 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:08.670722 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23f5598_3393_4ac3_8713_572956063835.slice/crio-72eb9ffd6f78b50ae849d62e04ad08aa0760cb6fbe6c09a3ff2bd4758de63a38 WatchSource:0}: Error finding container 72eb9ffd6f78b50ae849d62e04ad08aa0760cb6fbe6c09a3ff2bd4758de63a38: Status 404 returned error can't find the container with id 72eb9ffd6f78b50ae849d62e04ad08aa0760cb6fbe6c09a3ff2bd4758de63a38 Jun 15 01:58:08.748731 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.748480 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:53:07 +0000 UTC" deadline="2027-11-29 11:00:07.487991667 +0000 UTC" Jun 15 01:58:08.749072 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.748734 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12777h1m58.739265085s" Jun 15 01:58:08.791688 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.791657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s7ntl" event={"ID":"a23f5598-3393-4ac3-8713-572956063835","Type":"ContainerStarted","Data":"72eb9ffd6f78b50ae849d62e04ad08aa0760cb6fbe6c09a3ff2bd4758de63a38"} Jun 15 01:58:08.795923 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.795890 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" event={"ID":"780b4c5a-d475-46c1-80b9-939680e0c142","Type":"ContainerStarted","Data":"b6931e83f1b2562e9aa8ea7e6238e148bee20bdafbd59994d25acf58ba08308f"} Jun 15 01:58:08.797032 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.797004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rjqhj" event={"ID":"499434fd-8161-4177-8ea1-34f897544ef1","Type":"ContainerStarted","Data":"b3400966ad55025ed4239bb2751411032da551aa5029b69663f79c7c4b1b6be8"} Jun 15 01:58:08.799979 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.799953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" event={"ID":"578f1ddaea42b73ed5919bd0640b2e20","Type":"ContainerStarted","Data":"7947b8b6b8645daa957ac7c38808b05f3ff08e832c7b9bb8e012e4229c03fcd7"} Jun 15 01:58:08.804081 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.804051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"158e85d4f6d22b87d854df9621b8692f5a4103caaf1f6d22dd732880ca25c616"} Jun 15 01:58:08.805224 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.805193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hj85b" event={"ID":"1083a323-51f0-4221-bbce-2c7973b7c1a1","Type":"ContainerStarted","Data":"01c83eb9f0db472ec17b833d100479fe3ca0714b5885bf04a9cc1494562224ee"} Jun 15 01:58:08.806219 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.806195 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-454pb" event={"ID":"71e58f02-6f96-4006-be1f-ce7deed0d675","Type":"ContainerStarted","Data":"78d0656209180964e0b4485ce59ccb801588b1678be0ef57e350531842955d52"} Jun 15 01:58:08.807619 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.807594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" event={"ID":"42b6f6dd-987d-4e3c-a695-5fafb49fa23b","Type":"ContainerStarted","Data":"292a7a17985be96d2d4d7e98a754cd9083f14a2910a87f1f2f85939e69d9740f"} Jun 15 01:58:08.809707 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.809683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wjwwn" event={"ID":"624fe62d-eaad-433f-add3-8e090b7e1b38","Type":"ContainerStarted","Data":"7b3e73fe806e7dd3f05be149809329f10403067ce613fae6968807b1a126ef5a"} Jun 15 01:58:08.811185 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.811163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerStarted","Data":"8c071de69f6ba387a448066ba4cb7dcb6e7239f699c20eb203f23c49f5667c72"} Jun 15 01:58:08.814489 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:08.814447 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-93.ec2.internal" podStartSLOduration=1.8144350679999999 podStartE2EDuration="1.814435068s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:08.814021343 +0000 UTC m=+3.397913144" watchObservedRunningTime="2026-06-15 01:58:08.814435068 +0000 UTC m=+3.398326894" Jun 15 01:58:09.445051 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.445014 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:09.445225 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.445082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:09.445284 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.445223 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:09.445284 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.445257 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:09.445396 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.445293 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:58:11.445273613 +0000 UTC m=+6.029165408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:09.445396 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.445321 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:11.445303884 +0000 UTC m=+6.029195669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:09.545684 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.545649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:09.545867 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.545820 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:09.545867 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.545839 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:09.545867 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.545851 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:09.546018 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.545908 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:11.54589039 +0000 UTC m=+6.129782191 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:09.749159 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.749025 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 01:53:07 +0000 UTC" deadline="2027-11-12 07:50:00.559240695 +0000 UTC" Jun 15 01:58:09.749159 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.749090 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12365h51m50.810155118s" Jun 15 01:58:09.783742 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.783712 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:09.783903 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.783838 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:09.784294 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.784275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:09.784434 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.784412 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:09.784493 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.784483 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:09.784589 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:09.784572 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:09.837098 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.836991 2562 generic.go:356] "Generic (PLEG): container finished" podID="dd979c5062d272903f09f604fc27e5f6" containerID="e47e2c38db5684478905f19441069937fc6048d3f9ac1d3ce9d836faf250bc97" exitCode=0 Jun 15 01:58:09.838114 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:09.838078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"dd979c5062d272903f09f604fc27e5f6","Type":"ContainerDied","Data":"e47e2c38db5684478905f19441069937fc6048d3f9ac1d3ce9d836faf250bc97"} Jun 15 01:58:10.844413 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:10.843734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" event={"ID":"dd979c5062d272903f09f604fc27e5f6","Type":"ContainerStarted","Data":"8ba4182e054ad5fd95008ccc046a6c7bebbdcbc2778c283e618d57ed3a6dac6f"} Jun 15 01:58:10.858520 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:10.858465 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-93.ec2.internal" podStartSLOduration=3.858436721 podStartE2EDuration="3.858436721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:10.858014164 +0000 UTC m=+5.441905987" watchObservedRunningTime="2026-06-15 01:58:10.858436721 +0000 UTC m=+5.442328524" Jun 15 01:58:11.463918 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:11.463879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:11.464111 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:11.463946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:11.464111 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.464095 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:11.464222 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.464159 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:58:15.464140247 +0000 UTC m=+10.048032033 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:11.464585 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.464564 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:11.464712 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.464619 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:15.464604624 +0000 UTC m=+10.048496410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:11.564617 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:11.564580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:11.564780 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.564750 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:11.564780 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.564768 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:11.564895 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.564783 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:11.564895 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.564840 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:15.564822367 +0000 UTC m=+10.148714147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:11.782182 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:11.782094 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:11.782182 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:11.782131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:11.782182 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:11.782134 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:11.782455 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.782238 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:11.782715 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.782688 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:11.782809 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:11.782790 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:13.782158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:13.782061 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:13.782158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:13.782104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:13.782708 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:13.782203 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:13.782708 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:13.782251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:13.782708 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:13.782372 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:13.782708 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:13.782476 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:15.500029 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:15.499987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:15.500585 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:15.500057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:15.500585 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.500183 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:15.500585 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.500248 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:58:23.500228877 +0000 UTC m=+18.084120662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:15.500585 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.500183 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:15.500812 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.500632 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:23.500613288 +0000 UTC m=+18.084505068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:15.601276 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:15.601205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:15.601453 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.601402 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:15.601453 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.601433 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:15.601453 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.601446 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:15.601632 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.601518 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:23.6014993 +0000 UTC m=+18.185391081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:15.785338 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:15.784718 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:15.785338 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.784836 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:15.785338 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:15.784896 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:15.785338 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.785011 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:15.785338 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:15.785067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:15.785338 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:15.785138 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:17.782055 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:17.782021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:17.782055 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:17.782059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:17.782618 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:17.782028 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:17.782618 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:17.782154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:17.782618 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:17.782263 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:17.782618 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:17.782334 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:19.781928 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:19.781872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:19.782395 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:19.781872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:19.782395 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:19.782006 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:19.782395 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:19.782092 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:19.782395 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:19.781872 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:19.782395 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:19.782163 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:21.781139 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:21.781079 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:21.781661 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:21.781087 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:21.781661 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:21.781199 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:21.781661 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:21.781248 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:21.781661 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:21.781289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:21.781661 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:21.781360 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:23.559012 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:23.558971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:23.559458 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:23.559031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:23.559458 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.559160 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:23.559458 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.559161 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:23.559458 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.559219 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:58:39.55920573 +0000 UTC m=+34.143097511 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:23.559458 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.559234 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:39.559227599 +0000 UTC m=+34.143119382 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:23.659659 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:23.659610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:23.659844 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.659807 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:23.659844 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.659834 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:23.659922 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.659847 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:23.659964 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.659917 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:58:39.659897415 +0000 UTC m=+34.243789211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:23.781630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:23.781594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:23.781866 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:23.781647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:23.781866 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:23.781594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:23.781866 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.781743 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:23.781866 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.781841 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:23.782075 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:23.781926 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:25.782808 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:25.782770 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:25.783278 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:25.782897 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:25.783278 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:25.782903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:25.783278 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:25.783010 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:25.783278 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:25.783033 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:25.783278 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:25.783112 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:27.782030 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.781355 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:27.782030 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.781373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:27.782030 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.781742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:27.782918 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:27.782025 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:27.782918 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:27.782573 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:27.782918 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:27.782676 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:27.882325 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.882276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rjqhj" event={"ID":"499434fd-8161-4177-8ea1-34f897544ef1","Type":"ContainerStarted","Data":"2e18da7350070bb2bf63fd79caded0724c1b76e2a5fb08da5bc1240bdc9660e3"} Jun 15 01:58:27.885391 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.885366 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 01:58:27.885872 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.885844 2562 generic.go:356] "Generic (PLEG): container finished" podID="167e163e-9658-4668-8d8e-5bc3b21e94b5" containerID="e9793c58c65fe8cd1b75cb793e6e59634a800c0137716f4d3016e3280f38ce4a" exitCode=1 Jun 15 01:58:27.885986 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.885937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"3e00093adcef1b547ef39b7b1a698aa43644cfdaaf94b1200c4fa7d085a2c3d5"} Jun 15 01:58:27.886040 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.886018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"bbf1caa658523e645c598bb0c2f4d3a3827608e4a865c54b8b3d744c919a5871"} Jun 15 01:58:27.886099 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.886059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"17568bb1cb5a5e45905c7edcfb43f6f539fede81f8d2e9c916d7211abd58c2c8"} Jun 15 01:58:27.886153 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.886105 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"af05c653e7ce0e3a5d7ebfcd7a05024b2c111926e057390674874e4f9e7d8758"} Jun 15 01:58:27.886153 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.886148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerDied","Data":"e9793c58c65fe8cd1b75cb793e6e59634a800c0137716f4d3016e3280f38ce4a"} Jun 15 01:58:27.886249 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.886196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"b80093fdd4990909ad17c6ed7a031e66b10034d27def2faabeb1abaa2aac561c"} Jun 15 01:58:27.887705 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.887627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hj85b" event={"ID":"1083a323-51f0-4221-bbce-2c7973b7c1a1","Type":"ContainerStarted","Data":"6b9e913587416d6cf733d90b845fc8149dbecc88613f9ec467327e2b0f21bfbc"} Jun 15 01:58:27.889247 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.889209 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" event={"ID":"42b6f6dd-987d-4e3c-a695-5fafb49fa23b","Type":"ContainerStarted","Data":"d39b65346d518b3615d50322733b8bf36338e1d07d11d3f4e42860fdcfa0d01c"} Jun 15 01:58:27.891114 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.891071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wjwwn" event={"ID":"624fe62d-eaad-433f-add3-8e090b7e1b38","Type":"ContainerStarted","Data":"03f6c4081d8d5f7a30285f70a9c9c8be7f9300662786d965314444713cc6be94"} Jun 15 01:58:27.892916 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.892826 2562 generic.go:356] "Generic (PLEG): container finished" podID="7009d4dd-06b3-4f23-be79-ce339b4bd492" containerID="d4c08bc1b3df65690f33c0c9079fd7ccfe457b2b1f8c84da591085e0821a33e9" exitCode=0 Jun 15 01:58:27.892916 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.892854 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerDied","Data":"d4c08bc1b3df65690f33c0c9079fd7ccfe457b2b1f8c84da591085e0821a33e9"} Jun 15 01:58:27.894579 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.894554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s7ntl" event={"ID":"a23f5598-3393-4ac3-8713-572956063835","Type":"ContainerStarted","Data":"307b47308adf882a330237f14460be6da2dbb7c04ea38511d78921b8565811f1"} Jun 15 01:58:27.896915 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.896894 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" event={"ID":"780b4c5a-d475-46c1-80b9-939680e0c142","Type":"ContainerStarted","Data":"069864149f9ed9ddfa6e1f2a0ee2ba0327322ad25ab644edbfcd80126e52067f"} Jun 15 01:58:27.897925 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.897884 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rjqhj" podStartSLOduration=4.405420647 podStartE2EDuration="22.897848401s" totalImagesPullingTime="18.492427754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:27.897831413 +0000 UTC m=+22.481723215" watchObservedRunningTime="2026-06-15 01:58:27.897848401 +0000 UTC m=+22.481740199" Jun 15 01:58:27.930779 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.930724 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wjwwn" podStartSLOduration=4.5256444380000005 podStartE2EDuration="22.930708537s" totalImagesPullingTime="18.405064099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:27.930382037 +0000 UTC m=+22.514273839" watchObservedRunningTime="2026-06-15 01:58:27.930708537 +0000 UTC m=+22.514600338" Jun 15 01:58:27.959630 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:27.959575 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hj85b" podStartSLOduration=11.816644205 podStartE2EDuration="21.959557506s" totalImagesPullingTime="10.142913301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:27.959056385 +0000 UTC m=+22.542948189" watchObservedRunningTime="2026-06-15 01:58:27.959557506 +0000 UTC m=+22.543449307" Jun 15 01:58:28.005226 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.005168 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s7ntl" podStartSLOduration=4.609900457 podStartE2EDuration="23.005146057s" totalImagesPullingTime="18.3952456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:27.986960596 +0000 UTC m=+22.570852399" watchObservedRunningTime="2026-06-15 01:58:28.005146057 +0000 UTC m=+22.589037860" Jun 15 01:58:28.005603 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.005574 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k4qcm" podStartSLOduration=4.602426525 podStartE2EDuration="23.00556576s" totalImagesPullingTime="18.403139235s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:28.004691039 +0000 UTC m=+22.588582861" watchObservedRunningTime="2026-06-15 01:58:28.00556576 +0000 UTC m=+22.589457562" Jun 15 01:58:28.028362 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.028328 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:28.128545 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.128500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:28.228865 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.228832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:28.636645 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.636560 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 01:58:28.727325 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.727290 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:28.791017 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.790892 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T01:58:28.636583242Z","UUID":"44c6f2a4-c968-4ff2-8637-a2e21adc4bd7","Handler":null,"Name":"","Endpoint":""} Jun 15 01:58:28.792617 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.792591 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 01:58:28.792739 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.792636 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 01:58:28.903423 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.903292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-454pb" event={"ID":"71e58f02-6f96-4006-be1f-ce7deed0d675","Type":"ContainerStarted","Data":"9a7525fff40418bc9ca563c11e656e5f2950697a79c3c599f6262dcf57f1fee8"} Jun 15 01:58:28.905595 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.905564 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" event={"ID":"780b4c5a-d475-46c1-80b9-939680e0c142","Type":"ContainerStarted","Data":"d36d5b24ab0cf37847dbcbf9128d2e7600bd9215fb26c06b08f77baa6eacae32"} Jun 15 01:58:28.921083 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:28.921031 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-454pb" podStartSLOduration=4.524439118 podStartE2EDuration="22.921012555s" totalImagesPullingTime="18.396573437s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:28.920425935 +0000 UTC m=+23.504317736" watchObservedRunningTime="2026-06-15 01:58:28.921012555 +0000 UTC m=+23.504904356" Jun 15 01:58:29.781810 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:29.781772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:29.781990 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:29.781827 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:29.781990 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:29.781772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:29.781990 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:29.781923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:29.782158 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:29.782073 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:29.782215 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:29.782166 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:29.909819 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:29.909747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" event={"ID":"780b4c5a-d475-46c1-80b9-939680e0c142","Type":"ContainerStarted","Data":"227a5a4fb90993e7969cfb678989dfd94ff2caa56dab508d894e3240fc2a1ef6"} Jun 15 01:58:29.928449 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:29.928403 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tbcd6" podStartSLOduration=3.423655265 podStartE2EDuration="23.928385614s" totalImagesPullingTime="20.504730349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:29.927811897 +0000 UTC m=+24.511703701" watchObservedRunningTime="2026-06-15 01:58:29.928385614 +0000 UTC m=+24.512277417" Jun 15 01:58:30.859290 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:30.859129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:30.915510 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:30.915485 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 01:58:30.915962 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:30.915942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"a67f00484f6786d7ae254a7769b0638d38e17887f93bae29cd83d236ffb91778"} Jun 15 01:58:31.060132 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:31.060092 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:31.060729 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:31.060705 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:31.781928 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:31.781898 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:31.781928 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:31.781922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:31.782173 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:31.781898 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:31.782173 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:31.782028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:31.782173 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:31.782117 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:31.782342 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:31.782231 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:32.431435 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.431275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:32.488765 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.488666 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:32.489284 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.489257 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hj85b" Jun 15 01:58:32.507353 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.507326 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:32.796401 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.796309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:32.896321 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.896281 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:32.923992 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.923969 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 01:58:32.924348 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.924321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"489c82e96345be5477e7aea33faf50022fa302d1cd12688b8e83889a44db655b"} Jun 15 01:58:32.924652 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.924625 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:32.924847 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.924832 2562 scope.go:117] "RemoveContainer" containerID="e9793c58c65fe8cd1b75cb793e6e59634a800c0137716f4d3016e3280f38ce4a" Jun 15 01:58:32.926313 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.926287 2562 generic.go:356] "Generic (PLEG): container finished" podID="7009d4dd-06b3-4f23-be79-ce339b4bd492" containerID="46ca5017b397058329acd23a7390ba16faeae616e7cfb2125cdd6631ffdf87a1" exitCode=0 Jun 15 01:58:32.926395 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.926341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerDied","Data":"46ca5017b397058329acd23a7390ba16faeae616e7cfb2125cdd6631ffdf87a1"} Jun 15 01:58:32.940478 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.940447 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:32.996640 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:32.996607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:33.096344 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.096312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:33.214620 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.214583 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:33.315719 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.315688 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:33.483997 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.483928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:33.781362 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.781274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:33.781362 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.781293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:33.781362 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.781281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:33.781667 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:33.781375 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:33.781667 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:33.781436 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:33.781667 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:33.781498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:33.882589 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.882559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:33.931123 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.931095 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 01:58:33.931452 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.931416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" event={"ID":"167e163e-9658-4668-8d8e-5bc3b21e94b5","Type":"ContainerStarted","Data":"5502643bdb626348e302a7fc5b94fcf3d5d9c1090eebb47d3ee9995afcd954a7"} Jun 15 01:58:33.931665 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.931646 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:33.931766 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.931755 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:33.947024 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.946993 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:58:33.958242 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:33.958199 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" podStartSLOduration=9.471417114 podStartE2EDuration="27.958183678s" totalImagesPullingTime="18.486766564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:33.956602689 +0000 UTC m=+28.540494512" watchObservedRunningTime="2026-06-15 01:58:33.958183678 +0000 UTC m=+28.542075481" Jun 15 01:58:34.882506 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:34.882474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:34.935876 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:34.935847 2562 generic.go:356] "Generic (PLEG): container finished" podID="7009d4dd-06b3-4f23-be79-ce339b4bd492" containerID="c871cd29c1a7af3f9caf99f5e752678238ae3ee71bc2d4282b795bb46397e95d" exitCode=0 Jun 15 01:58:34.936019 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:34.935931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerDied","Data":"c871cd29c1a7af3f9caf99f5e752678238ae3ee71bc2d4282b795bb46397e95d"} Jun 15 01:58:35.234457 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.234370 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:35.335249 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.335215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:35.482815 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.482785 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:35.683060 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.683030 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:35.782393 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.782360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:35.782609 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:35.782461 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:35.782609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.782468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:35.782609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.782500 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:35.782609 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:35.782551 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:35.782876 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:35.782612 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:35.884703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:35.884676 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:36.475362 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:36.475327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:36.798055 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:36.797968 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:36.942868 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:36.942837 2562 generic.go:356] "Generic (PLEG): container finished" podID="7009d4dd-06b3-4f23-be79-ce339b4bd492" containerID="aace49be199b53a59a91c3ab2bc586ffe3a72a56238bc8313aaaac81e5ba4d1f" exitCode=0 Jun 15 01:58:36.943214 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:36.942882 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerDied","Data":"aace49be199b53a59a91c3ab2bc586ffe3a72a56238bc8313aaaac81e5ba4d1f"} Jun 15 01:58:37.082946 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.082914 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:37.281509 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.281477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:37.480693 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.480600 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:37.679581 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.679548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:37.780038 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.779932 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:37.782420 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.781989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:37.782420 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.781990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:37.782420 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:37.782121 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:37.782420 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.781993 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:37.782420 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:37.782224 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:37.782420 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:37.782249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:37.882406 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:37.882369 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:38.516962 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:38.516916 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:38.882078 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:38.882046 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:39.082437 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.082408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:39.480168 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.480137 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:39.575044 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.575007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:39.575044 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.575046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:39.575506 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.575145 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:39.575506 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.575172 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:39.575506 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.575191 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs podName:67ff0471-0c24-4354-a459-310b8c44af0c nodeName:}" failed. No retries permitted until 2026-06-15 01:59:11.575177677 +0000 UTC m=+66.159069457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs") pod "network-metrics-daemon-lxtkn" (UID: "67ff0471-0c24-4354-a459-310b8c44af0c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 01:58:39.575506 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.575232 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret podName:fe74fdac-c36b-4513-ab6b-a73ae892e085 nodeName:}" failed. No retries permitted until 2026-06-15 01:59:11.57521421 +0000 UTC m=+66.159106011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret") pod "global-pull-secret-syncer-x9kcc" (UID: "fe74fdac-c36b-4513-ab6b-a73ae892e085") : object "kube-system"/"original-pull-secret" not registered Jun 15 01:58:39.675813 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.675779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:39.675969 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.675933 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 01:58:39.675969 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.675954 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 01:58:39.675969 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.675964 2562 projected.go:196] Error preparing data for projected volume kube-api-access-tfhxf for pod openshift-network-diagnostics/network-check-target-8k9v2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:39.676064 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.676012 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf podName:258f8df5-12d3-40c0-af2b-41326b3df1d8 nodeName:}" failed. No retries permitted until 2026-06-15 01:59:11.675997995 +0000 UTC m=+66.259889775 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tfhxf" (UniqueName: "kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf") pod "network-check-target-8k9v2" (UID: "258f8df5-12d3-40c0-af2b-41326b3df1d8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 01:58:39.680086 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.680051 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:39.781808 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.781723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:39.781808 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.781751 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:39.782013 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:39.781723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:39.782013 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.781845 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:39.782013 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.781946 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:39.782110 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:39.782036 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:40.078239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:40.078200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:40.179267 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:40.179234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:40.886625 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:40.886591 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.278478 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.278398 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.481403 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.481372 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.583309 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.583276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.682827 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.682794 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.781786 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.781750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:41.781786 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.781750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:41.782039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.781776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:41.782039 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:41.781876 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:41.782039 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:41.782005 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:41.782199 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:41.782076 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:41.782788 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.782765 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.883249 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.883198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:41.958811 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.958775 2562 generic.go:356] "Generic (PLEG): container finished" podID="7009d4dd-06b3-4f23-be79-ce339b4bd492" containerID="abadc8570010f9794754d70b7a2a328446fe78d40e1a87e533abc3c2246031f5" exitCode=0 Jun 15 01:58:41.959178 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:41.958837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerDied","Data":"abadc8570010f9794754d70b7a2a328446fe78d40e1a87e533abc3c2246031f5"} Jun 15 01:58:42.082407 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.082377 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.218290 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.218201 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.319436 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.319408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.628431 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.628405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.698055 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.698023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.745731 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.745695 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.851148 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.851119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:42.963975 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.963898 2562 generic.go:356] "Generic (PLEG): container finished" podID="7009d4dd-06b3-4f23-be79-ce339b4bd492" containerID="b2845f59c52bc2d8240b287211d34c61d4bcab5a08dde9e545a555decb3fcb71" exitCode=0 Jun 15 01:58:42.963975 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:42.963937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerDied","Data":"b2845f59c52bc2d8240b287211d34c61d4bcab5a08dde9e545a555decb3fcb71"} Jun 15 01:58:43.078799 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.078766 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:43.226830 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.226750 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:43.327057 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.327026 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:43.426508 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.426478 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:43.528500 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.528420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:43.781423 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.781338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:43.781578 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.781339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:43.781578 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.781339 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:43.781656 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:43.781581 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:43.781656 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:43.781438 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:43.781656 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:43.781638 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:43.877988 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.877952 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:43.969612 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.969580 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hb74t" event={"ID":"7009d4dd-06b3-4f23-be79-ce339b4bd492","Type":"ContainerStarted","Data":"6381e81532a788a4a4aa0bfe0d384e6622cd1afdf7dbfbe1f64676b2093d74be"} Jun 15 01:58:43.992477 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:43.992426 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hb74t" podStartSLOduration=9.18681584 podStartE2EDuration="38.992412045s" totalImagesPullingTime="29.805596205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:58:43.99186894 +0000 UTC m=+38.575760744" watchObservedRunningTime="2026-06-15 01:58:43.992412045 +0000 UTC m=+38.576303847" Jun 15 01:58:44.855266 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:44.855233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:44.906641 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:44.906610 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:45.782546 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:45.782512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:45.783028 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:45.782621 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:45.783028 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:45.782709 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:45.783028 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:45.782813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:45.783028 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:45.782844 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:45.783028 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:45.782889 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:47.749928 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:47.749899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:47.781367 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:47.781336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:47.781472 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:47.781338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:47.781472 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:47.781435 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:47.781612 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:47.781504 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:47.781612 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:47.781552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:47.781713 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:47.781655 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:47.803247 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:47.803216 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:49.781557 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:49.781503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:49.781557 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:49.781517 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:49.781557 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:49.781517 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:49.782131 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:49.781626 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:49.782131 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:49.781709 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:49.782131 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:49.781768 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:50.247006 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:50.246974 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:50.293458 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:50.293431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:50.905076 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:50.905046 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:51.003304 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.003273 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:51.106207 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.106175 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:51.202429 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.202352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:51.291323 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.291293 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:51.782141 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.782107 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:51.782343 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.782110 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:51.782343 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:51.782212 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:51.782343 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:51.782115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:51.782343 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:51.782298 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:51.782606 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:51.782375 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:52.180996 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:52.180957 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9kcc"] Jun 15 01:58:52.181625 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:52.181081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:52.181625 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:52.181171 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:52.185024 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:52.184985 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxtkn"] Jun 15 01:58:52.185150 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:52.185113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:52.185246 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:52.185223 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:52.185708 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:52.185685 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8k9v2"] Jun 15 01:58:52.185826 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:52.185761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:52.185882 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:52.185844 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:53.065947 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.065914 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:53.116787 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.116753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:53.546631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.546601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:53.781288 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.781250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:53.781453 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.781250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:53.781453 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:53.781370 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:53.781453 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.781386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:53.781581 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:53.781454 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:53.781581 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:53.781517 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:53.879576 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.879527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:53.927455 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:53.927420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:55.161279 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:55.161244 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:55.321116 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:55.321063 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:55.618138 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:55.618075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:55.782907 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:55.782746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:55.783066 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:55.782823 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:55.783066 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:55.782854 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:55.783190 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:55.783063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8k9v2" podUID="258f8df5-12d3-40c0-af2b-41326b3df1d8" Jun 15 01:58:55.783190 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:55.782968 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9kcc" podUID="fe74fdac-c36b-4513-ab6b-a73ae892e085" Jun 15 01:58:55.783190 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:58:55.783161 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lxtkn" podUID="67ff0471-0c24-4354-a459-310b8c44af0c" Jun 15 01:58:56.231463 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.231436 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-93.ec2.internal" event="NodeReady" Jun 15 01:58:56.231861 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.231583 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 01:58:56.275619 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.275580 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lpxn5"] Jun 15 01:58:56.305201 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.305169 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lrbw4"] Jun 15 01:58:56.305380 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.305304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.307613 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.307586 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 01:58:56.307740 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.307620 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 01:58:56.307814 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.307760 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6cn29\"" Jun 15 01:58:56.307868 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.307844 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 01:58:56.318922 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.318894 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lpxn5"] Jun 15 01:58:56.319041 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.318931 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrbw4"] Jun 15 01:58:56.319041 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.319013 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.321858 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.321830 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 01:58:56.321971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.321888 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 01:58:56.321971 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.321891 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 01:58:56.322083 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.322074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 01:58:56.322140 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.322131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-jx8p9\"" Jun 15 01:58:56.376654 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.376620 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tf2dr"] Jun 15 01:58:56.401729 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.401695 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tf2dr"] Jun 15 01:58:56.401884 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.401792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.404704 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.404653 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 01:58:56.405061 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.405037 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t8zzc\"" Jun 15 01:58:56.405882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.405864 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 01:58:56.467113 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.467083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:56.495459 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0411f206-78c8-458a-a277-573b9a14615d-cert\") pod \"ingress-canary-lpxn5\" (UID: \"0411f206-78c8-458a-a277-573b9a14615d\") " pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.495459 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495422 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ee0514-d93b-4d61-8799-8176b7eb97f3-tmp-dir\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.495459 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495453 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdba5a13-3ae7-4290-a97f-b370a7c18822-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.495716 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdba5a13-3ae7-4290-a97f-b370a7c18822-crio-socket\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.495716 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdba5a13-3ae7-4290-a97f-b370a7c18822-data-volume\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.495716 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47ee0514-d93b-4d61-8799-8176b7eb97f3-metrics-tls\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.495716 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t26v\" (UniqueName: \"kubernetes.io/projected/47ee0514-d93b-4d61-8799-8176b7eb97f3-kube-api-access-4t26v\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.495716 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47ee0514-d93b-4d61-8799-8176b7eb97f3-config-volume\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.495918 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45pn6\" (UniqueName: \"kubernetes.io/projected/0411f206-78c8-458a-a277-573b9a14615d-kube-api-access-45pn6\") pod \"ingress-canary-lpxn5\" (UID: \"0411f206-78c8-458a-a277-573b9a14615d\") " pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.495918 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qws\" (UniqueName: \"kubernetes.io/projected/cdba5a13-3ae7-4290-a97f-b370a7c18822-kube-api-access-24qws\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.495918 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.495811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdba5a13-3ae7-4290-a97f-b370a7c18822-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.572495 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.572465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:56.596657 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdba5a13-3ae7-4290-a97f-b370a7c18822-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.596657 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdba5a13-3ae7-4290-a97f-b370a7c18822-crio-socket\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdba5a13-3ae7-4290-a97f-b370a7c18822-data-volume\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47ee0514-d93b-4d61-8799-8176b7eb97f3-metrics-tls\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t26v\" (UniqueName: \"kubernetes.io/projected/47ee0514-d93b-4d61-8799-8176b7eb97f3-kube-api-access-4t26v\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47ee0514-d93b-4d61-8799-8176b7eb97f3-config-volume\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596784 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45pn6\" (UniqueName: \"kubernetes.io/projected/0411f206-78c8-458a-a277-573b9a14615d-kube-api-access-45pn6\") pod \"ingress-canary-lpxn5\" (UID: \"0411f206-78c8-458a-a277-573b9a14615d\") " pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qws\" (UniqueName: \"kubernetes.io/projected/cdba5a13-3ae7-4290-a97f-b370a7c18822-kube-api-access-24qws\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdba5a13-3ae7-4290-a97f-b370a7c18822-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.596882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdba5a13-3ae7-4290-a97f-b370a7c18822-crio-socket\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.597247 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0411f206-78c8-458a-a277-573b9a14615d-cert\") pod \"ingress-canary-lpxn5\" (UID: \"0411f206-78c8-458a-a277-573b9a14615d\") " pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.597247 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.596925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ee0514-d93b-4d61-8799-8176b7eb97f3-tmp-dir\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.597247 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.597065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdba5a13-3ae7-4290-a97f-b370a7c18822-data-volume\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.597247 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.597209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47ee0514-d93b-4d61-8799-8176b7eb97f3-tmp-dir\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.597479 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.597438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/47ee0514-d93b-4d61-8799-8176b7eb97f3-config-volume\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.597637 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.597621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdba5a13-3ae7-4290-a97f-b370a7c18822-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.600676 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.600654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/47ee0514-d93b-4d61-8799-8176b7eb97f3-metrics-tls\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.600809 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.600790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdba5a13-3ae7-4290-a97f-b370a7c18822-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.600910 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.600896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0411f206-78c8-458a-a277-573b9a14615d-cert\") pod \"ingress-canary-lpxn5\" (UID: \"0411f206-78c8-458a-a277-573b9a14615d\") " pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.604722 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.604701 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t26v\" (UniqueName: \"kubernetes.io/projected/47ee0514-d93b-4d61-8799-8176b7eb97f3-kube-api-access-4t26v\") pod \"dns-default-tf2dr\" (UID: \"47ee0514-d93b-4d61-8799-8176b7eb97f3\") " pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.604856 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.604796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qws\" (UniqueName: \"kubernetes.io/projected/cdba5a13-3ae7-4290-a97f-b370a7c18822-kube-api-access-24qws\") pod \"insights-runtime-extractor-lrbw4\" (UID: \"cdba5a13-3ae7-4290-a97f-b370a7c18822\") " pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.604921 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.604872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45pn6\" (UniqueName: \"kubernetes.io/projected/0411f206-78c8-458a-a277-573b9a14615d-kube-api-access-45pn6\") pod \"ingress-canary-lpxn5\" (UID: \"0411f206-78c8-458a-a277-573b9a14615d\") " pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.614569 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.614545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lpxn5" Jun 15 01:58:56.627751 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.627727 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lrbw4" Jun 15 01:58:56.712972 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.712938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tf2dr" Jun 15 01:58:56.832326 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.832291 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lpxn5"] Jun 15 01:58:56.833290 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.832929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lrbw4"] Jun 15 01:58:56.836313 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:56.836273 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdba5a13_3ae7_4290_a97f_b370a7c18822.slice/crio-0d808ea53a682447ca88d257105b2a9def7c3a51a5cda5f7b4596d9e030166b7 WatchSource:0}: Error finding container 0d808ea53a682447ca88d257105b2a9def7c3a51a5cda5f7b4596d9e030166b7: Status 404 returned error can't find the container with id 0d808ea53a682447ca88d257105b2a9def7c3a51a5cda5f7b4596d9e030166b7 Jun 15 01:58:56.836757 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:56.836734 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0411f206_78c8_458a_a277_573b9a14615d.slice/crio-0ab25f8c9fecf243d0a03a25391661a61c4f27820a96f393fe4545766eb1930d WatchSource:0}: Error finding container 0ab25f8c9fecf243d0a03a25391661a61c4f27820a96f393fe4545766eb1930d: Status 404 returned error can't find the container with id 0ab25f8c9fecf243d0a03a25391661a61c4f27820a96f393fe4545766eb1930d Jun 15 01:58:56.853102 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.853068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:56.868876 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.868844 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tf2dr"] Jun 15 01:58:56.872420 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:58:56.872385 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47ee0514_d93b_4d61_8799_8176b7eb97f3.slice/crio-39dbe2ef4558c60dc94b081fbbbf046849aa7a04f3084c0ed7bf822b9416485e WatchSource:0}: Error finding container 39dbe2ef4558c60dc94b081fbbbf046849aa7a04f3084c0ed7bf822b9416485e: Status 404 returned error can't find the container with id 39dbe2ef4558c60dc94b081fbbbf046849aa7a04f3084c0ed7bf822b9416485e Jun 15 01:58:56.953999 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.953965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:58:56.999890 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:56.999855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tf2dr" event={"ID":"47ee0514-d93b-4d61-8799-8176b7eb97f3","Type":"ContainerStarted","Data":"39dbe2ef4558c60dc94b081fbbbf046849aa7a04f3084c0ed7bf822b9416485e"} Jun 15 01:58:57.001012 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.000982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrbw4" event={"ID":"cdba5a13-3ae7-4290-a97f-b370a7c18822","Type":"ContainerStarted","Data":"0d808ea53a682447ca88d257105b2a9def7c3a51a5cda5f7b4596d9e030166b7"} Jun 15 01:58:57.002058 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.002040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lpxn5" event={"ID":"0411f206-78c8-458a-a277-573b9a14615d","Type":"ContainerStarted","Data":"0ab25f8c9fecf243d0a03a25391661a61c4f27820a96f393fe4545766eb1930d"} Jun 15 01:58:57.783796 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.782287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:58:57.783796 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.783019 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:58:57.783796 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.783373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:58:57.785528 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.785504 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:58:57.785805 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.785772 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:58:57.786655 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.786441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mckb\"" Jun 15 01:58:57.786952 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.786934 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:58:57.787154 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.787138 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:58:57.787338 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:58:57.787323 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rgn9m\"" Jun 15 01:59:00.048085 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.047915 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98759b5ff-ks5bb"] Jun 15 01:59:00.131609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.131552 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98759b5ff-ks5bb"] Jun 15 01:59:00.131766 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.131664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.134378 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.134355 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m79qx\"" Jun 15 01:59:00.135339 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.135318 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 15 01:59:00.135822 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.135594 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 01:59:00.135822 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.135708 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 15 01:59:00.135822 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.135740 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 15 01:59:00.136746 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.136385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 15 01:59:00.136746 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.136477 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 01:59:00.136746 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.136573 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 15 01:59:00.142130 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.142112 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 15 01:59:00.225427 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-oauth-config\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.225605 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-service-ca\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.225605 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-config\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.225605 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-trusted-ca-bundle\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.225605 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx69r\" (UniqueName: \"kubernetes.io/projected/112b63a3-da51-432a-a0a2-d68c0e0ef324-kube-api-access-sx69r\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.225764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-serving-cert\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.225764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.225721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-oauth-serving-cert\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-oauth-serving-cert\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-oauth-config\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-service-ca\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-config\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-trusted-ca-bundle\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326308 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx69r\" (UniqueName: \"kubernetes.io/projected/112b63a3-da51-432a-a0a2-d68c0e0ef324-kube-api-access-sx69r\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.326514 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.326347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-serving-cert\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.327613 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.327490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-oauth-serving-cert\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.327613 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.327525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-service-ca\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.327849 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.327809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-trusted-ca-bundle\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.327964 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.327942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-config\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.330504 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.330480 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-oauth-config\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.330628 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.330574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-serving-cert\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.334605 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.334584 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx69r\" (UniqueName: \"kubernetes.io/projected/112b63a3-da51-432a-a0a2-d68c0e0ef324-kube-api-access-sx69r\") pod \"console-98759b5ff-ks5bb\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.445776 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.445738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:00.651749 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.651620 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:00.700272 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.700225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:00.967480 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:00.967364 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.206085 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.206047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.262885 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.262801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.353741 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.353709 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.396179 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.396151 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv"] Jun 15 01:59:01.418294 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.418265 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:01.420494 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.420477 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv"] Jun 15 01:59:01.420590 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.420579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.423673 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.423646 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 01:59:01.423791 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.423646 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 01:59:01.424694 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.424680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 01:59:01.424979 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.424965 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 01:59:01.424979 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.424976 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 01:59:01.425108 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.425019 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5f9vb\"" Jun 15 01:59:01.432912 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.432894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1d4197a-8d70-4d81-8454-ea6a203a7baf-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.433047 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.432920 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ncc4\" (UniqueName: \"kubernetes.io/projected/c1d4197a-8d70-4d81-8454-ea6a203a7baf-kube-api-access-2ncc4\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.433047 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.432996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.433047 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.433029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.534026 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.533932 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1d4197a-8d70-4d81-8454-ea6a203a7baf-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.534026 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.533983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ncc4\" (UniqueName: \"kubernetes.io/projected/c1d4197a-8d70-4d81-8454-ea6a203a7baf-kube-api-access-2ncc4\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.534244 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.534144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.534244 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.534189 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.534373 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:01.534312 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 01:59:01.534438 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:01.534387 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls podName:c1d4197a-8d70-4d81-8454-ea6a203a7baf nodeName:}" failed. No retries permitted until 2026-06-15 01:59:02.034365592 +0000 UTC m=+56.618257391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-6cnbv" (UID: "c1d4197a-8d70-4d81-8454-ea6a203a7baf") : secret "prometheus-operator-tls" not found Jun 15 01:59:01.534745 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.534720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1d4197a-8d70-4d81-8454-ea6a203a7baf-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.536756 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.536736 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:01.543251 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:01.543228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ncc4\" (UniqueName: \"kubernetes.io/projected/c1d4197a-8d70-4d81-8454-ea6a203a7baf-kube-api-access-2ncc4\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:02.026460 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:02.026434 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98759b5ff-ks5bb"] Jun 15 01:59:02.029563 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:02.029521 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod112b63a3_da51_432a_a0a2_d68c0e0ef324.slice/crio-c37042b8ae03523a3e47d76666069d2323237b3ae6cdfde8eae8dffa8f86cacf WatchSource:0}: Error finding container c37042b8ae03523a3e47d76666069d2323237b3ae6cdfde8eae8dffa8f86cacf: Status 404 returned error can't find the container with id c37042b8ae03523a3e47d76666069d2323237b3ae6cdfde8eae8dffa8f86cacf Jun 15 01:59:02.038506 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:02.038477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:02.038648 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:02.038632 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 15 01:59:02.038717 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:02.038698 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls podName:c1d4197a-8d70-4d81-8454-ea6a203a7baf nodeName:}" failed. No retries permitted until 2026-06-15 01:59:03.038682896 +0000 UTC m=+57.622574694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls") pod "prometheus-operator-864fcfc6f9-6cnbv" (UID: "c1d4197a-8d70-4d81-8454-ea6a203a7baf") : secret "prometheus-operator-tls" not found Jun 15 01:59:02.085189 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:02.085011 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:03.023555 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.023447 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tf2dr" event={"ID":"47ee0514-d93b-4d61-8799-8176b7eb97f3","Type":"ContainerStarted","Data":"2480fae237e54e3f0a7c333cbde36ea312f775a1bdfe400373a902a743d4b17c"} Jun 15 01:59:03.024014 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.023596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tf2dr" event={"ID":"47ee0514-d93b-4d61-8799-8176b7eb97f3","Type":"ContainerStarted","Data":"deecf1af26f01cc1b38267de761dee68601ea143d05910ae3094919c5de1cde6"} Jun 15 01:59:03.024014 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.023628 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tf2dr" Jun 15 01:59:03.025347 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.025318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lpxn5" event={"ID":"0411f206-78c8-458a-a277-573b9a14615d","Type":"ContainerStarted","Data":"06d68de736d95807150a01b05d85685b6263ee4c354d1be82a9ff735258856e9"} Jun 15 01:59:03.027056 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.027016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrbw4" event={"ID":"cdba5a13-3ae7-4290-a97f-b370a7c18822","Type":"ContainerStarted","Data":"f1eadfaa1cd0d2bb451a4bc0a5a245f614d035d11305b53608dadf69ab15081b"} Jun 15 01:59:03.028293 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.028268 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98759b5ff-ks5bb" event={"ID":"112b63a3-da51-432a-a0a2-d68c0e0ef324","Type":"ContainerStarted","Data":"c37042b8ae03523a3e47d76666069d2323237b3ae6cdfde8eae8dffa8f86cacf"} Jun 15 01:59:03.041810 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.041244 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tf2dr" podStartSLOduration=2.024486836 podStartE2EDuration="7.041224099s" totalImagesPullingTime="5.016737263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:03.040022004 +0000 UTC m=+57.623913831" watchObservedRunningTime="2026-06-15 01:59:03.041224099 +0000 UTC m=+57.625115898" Jun 15 01:59:03.047198 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.047149 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:03.050080 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.050047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1d4197a-8d70-4d81-8454-ea6a203a7baf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-6cnbv\" (UID: \"c1d4197a-8d70-4d81-8454-ea6a203a7baf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:03.056264 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.055996 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lpxn5" podStartSLOduration=2.003639383 podStartE2EDuration="7.055977271s" totalImagesPullingTime="5.052337888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:58:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:03.05482095 +0000 UTC m=+57.638712753" watchObservedRunningTime="2026-06-15 01:59:03.055977271 +0000 UTC m=+57.639869075" Jun 15 01:59:03.062361 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.062331 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:03.159225 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.159191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:03.229374 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.229321 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" Jun 15 01:59:03.467009 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:03.466972 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv"] Jun 15 01:59:03.471371 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:03.471341 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d4197a_8d70_4d81_8454_ea6a203a7baf.slice/crio-50773ea1422d7272caef22d7305489bde68105c27c8023943a2058ad8d35113b WatchSource:0}: Error finding container 50773ea1422d7272caef22d7305489bde68105c27c8023943a2058ad8d35113b: Status 404 returned error can't find the container with id 50773ea1422d7272caef22d7305489bde68105c27c8023943a2058ad8d35113b Jun 15 01:59:04.032579 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:04.032523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" event={"ID":"c1d4197a-8d70-4d81-8454-ea6a203a7baf","Type":"ContainerStarted","Data":"50773ea1422d7272caef22d7305489bde68105c27c8023943a2058ad8d35113b"} Jun 15 01:59:05.040104 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.040017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrbw4" event={"ID":"cdba5a13-3ae7-4290-a97f-b370a7c18822","Type":"ContainerStarted","Data":"0b2394aab089d68b73733d271f879a12a0bdcf2a90263e98e27c59d5497f3a3a"} Jun 15 01:59:05.041590 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.041563 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98759b5ff-ks5bb" event={"ID":"112b63a3-da51-432a-a0a2-d68c0e0ef324","Type":"ContainerStarted","Data":"51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64"} Jun 15 01:59:05.052594 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.052561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:05.058746 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.058706 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98759b5ff-ks5bb" podStartSLOduration=2.348940145 podStartE2EDuration="5.058691109s" totalImagesPullingTime="2.709750964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:05.057825668 +0000 UTC m=+59.641717471" watchObservedRunningTime="2026-06-15 01:59:05.058691109 +0000 UTC m=+59.642582910" Jun 15 01:59:05.153717 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.153682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:05.206301 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.206266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:05.912174 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.912090 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:05.950671 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:05.950645 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bql95" Jun 15 01:59:06.047699 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:06.047654 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" event={"ID":"c1d4197a-8d70-4d81-8454-ea6a203a7baf","Type":"ContainerStarted","Data":"9996e9132976b996bbe848d89d315e86687d9419a0143bd54ada76bfdfc7046b"} Jun 15 01:59:06.048158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:06.047758 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" event={"ID":"c1d4197a-8d70-4d81-8454-ea6a203a7baf","Type":"ContainerStarted","Data":"567b7ed5b0ddea1bbb8cf1c85c605ec03c6305ef079c0d2be31708d7403b8e54"} Jun 15 01:59:06.063797 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:06.063683 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-6cnbv" podStartSLOduration=2.921396022 podStartE2EDuration="5.063664664s" totalImagesPullingTime="2.142268642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:06.062596797 +0000 UTC m=+60.646488600" watchObservedRunningTime="2026-06-15 01:59:06.063664664 +0000 UTC m=+60.647556466" Jun 15 01:59:06.064000 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:06.063813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:06.121701 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:06.121663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:07.052785 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.052683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lrbw4" event={"ID":"cdba5a13-3ae7-4290-a97f-b370a7c18822","Type":"ContainerStarted","Data":"826d55419551ddfa7b8f8f9e763f45d6d2ea56312e4304fa6d168f0a2c6197e0"} Jun 15 01:59:07.068850 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.068800 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lrbw4" podStartSLOduration=1.5505666150000001 podStartE2EDuration="11.06878227s" totalImagesPullingTime="9.518215655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:07.067916587 +0000 UTC m=+61.651808407" watchObservedRunningTime="2026-06-15 01:59:07.06878227 +0000 UTC m=+61.652674071" Jun 15 01:59:07.498471 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.498440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:07.710224 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.710192 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:07.738864 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.738831 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx"] Jun 15 01:59:07.742021 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.742004 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.744699 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.744680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-6qzrp\"" Jun 15 01:59:07.745157 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.745136 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 15 01:59:07.745258 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.745177 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 15 01:59:07.754734 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.754664 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx"] Jun 15 01:59:07.784843 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.784813 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp"] Jun 15 01:59:07.787908 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.787888 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.789005 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.788986 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx9kv\" (UniqueName: \"kubernetes.io/projected/aee1abf3-5762-446d-8584-6ae78c73413d-kube-api-access-kx9kv\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.789095 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.789014 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.789095 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.789045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee1abf3-5762-446d-8584-6ae78c73413d-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.789095 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.789082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.790765 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.790741 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 01:59:07.790864 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.790779 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 01:59:07.790864 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.790743 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 01:59:07.795950 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.795929 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tlmt2\"" Jun 15 01:59:07.813212 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.813184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp"] Jun 15 01:59:07.824915 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.824889 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-w5hs4"] Jun 15 01:59:07.827909 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.827892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.830411 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.830383 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 01:59:07.830411 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.830389 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 01:59:07.830768 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.830748 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m2k29\"" Jun 15 01:59:07.830880 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.830868 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 01:59:07.840104 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.840080 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:07.889986 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.889947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe81919-18ee-43eb-8c97-36f55fff7c9f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.889986 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.889991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx9kv\" (UniqueName: \"kubernetes.io/projected/aee1abf3-5762-446d-8584-6ae78c73413d-kube-api-access-kx9kv\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-textfile\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890063 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-sys\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890145 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee1abf3-5762-446d-8584-6ae78c73413d-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bfe81919-18ee-43eb-8c97-36f55fff7c9f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.890239 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:07.890238 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 15 01:59:07.890525 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.890525 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890287 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.890525 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890525 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:07.890477 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls podName:aee1abf3-5762-446d-8584-6ae78c73413d nodeName:}" failed. No retries permitted until 2026-06-15 01:59:08.390451567 +0000 UTC m=+62.974343351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-5xddx" (UID: "aee1abf3-5762-446d-8584-6ae78c73413d") : secret "openshift-state-metrics-tls" not found Jun 15 01:59:07.890713 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.890713 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-root\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890713 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrt22\" (UniqueName: \"kubernetes.io/projected/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-api-access-vrt22\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.890713 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.890713 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe3d11c8-e168-4363-ab38-c45569cb532d-metrics-client-ca\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890929 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-tls\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890929 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-wtmp\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.890929 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqwss\" (UniqueName: \"kubernetes.io/projected/fe3d11c8-e168-4363-ab38-c45569cb532d-kube-api-access-nqwss\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.891019 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.890944 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aee1abf3-5762-446d-8584-6ae78c73413d-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.892735 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.892717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.900310 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.900281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx9kv\" (UniqueName: \"kubernetes.io/projected/aee1abf3-5762-446d-8584-6ae78c73413d-kube-api-access-kx9kv\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:07.937392 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.937358 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:07.991736 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-root\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrt22\" (UniqueName: \"kubernetes.io/projected/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-api-access-vrt22\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe3d11c8-e168-4363-ab38-c45569cb532d-metrics-client-ca\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991825 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-root\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-tls\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.991888 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.991864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-wtmp\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:07.991936 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:07.992007 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-tls podName:fe3d11c8-e168-4363-ab38-c45569cb532d nodeName:}" failed. No retries permitted until 2026-06-15 01:59:08.49199156 +0000 UTC m=+63.075883343 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-tls") pod "node-exporter-w5hs4" (UID: "fe3d11c8-e168-4363-ab38-c45569cb532d") : secret "node-exporter-tls" not found Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-wtmp\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqwss\" (UniqueName: \"kubernetes.io/projected/fe3d11c8-e168-4363-ab38-c45569cb532d-kube-api-access-nqwss\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992162 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe81919-18ee-43eb-8c97-36f55fff7c9f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-textfile\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-sys\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992274 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bfe81919-18ee-43eb-8c97-36f55fff7c9f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.992703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.992703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992463 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe3d11c8-e168-4363-ab38-c45569cb532d-metrics-client-ca\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.992703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-textfile\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.992703 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fe3d11c8-e168-4363-ab38-c45569cb532d-sys\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.993007 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.992799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bfe81919-18ee-43eb-8c97-36f55fff7c9f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.993063 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.993042 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfe81919-18ee-43eb-8c97-36f55fff7c9f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.993118 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.993083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-accelerators-collector-config\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.994429 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.994392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.994548 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.994458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.994666 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.994650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:07.999701 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.999676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqwss\" (UniqueName: \"kubernetes.io/projected/fe3d11c8-e168-4363-ab38-c45569cb532d-kube-api-access-nqwss\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:07.999801 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:07.999717 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrt22\" (UniqueName: \"kubernetes.io/projected/bfe81919-18ee-43eb-8c97-36f55fff7c9f-kube-api-access-vrt22\") pod \"kube-state-metrics-678bc549d7-6tmfp\" (UID: \"bfe81919-18ee-43eb-8c97-36f55fff7c9f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:08.037687 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.037595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.096697 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.096664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" Jun 15 01:59:08.131629 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.131595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.189896 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.189858 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.225831 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.225799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp"] Jun 15 01:59:08.229733 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:08.229708 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe81919_18ee_43eb_8c97_36f55fff7c9f.slice/crio-77f127d06f904ee90a0bf1cf027ee537cbcdeaf4511e99a4a5ac2ee247540b23 WatchSource:0}: Error finding container 77f127d06f904ee90a0bf1cf027ee537cbcdeaf4511e99a4a5ac2ee247540b23: Status 404 returned error can't find the container with id 77f127d06f904ee90a0bf1cf027ee537cbcdeaf4511e99a4a5ac2ee247540b23 Jun 15 01:59:08.313077 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.312997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.396614 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.396581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:08.396745 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:08.396693 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 15 01:59:08.396784 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:08.396748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls podName:aee1abf3-5762-446d-8584-6ae78c73413d nodeName:}" failed. No retries permitted until 2026-06-15 01:59:09.396734529 +0000 UTC m=+63.980626309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-5xddx" (UID: "aee1abf3-5762-446d-8584-6ae78c73413d") : secret "openshift-state-metrics-tls" not found Jun 15 01:59:08.436168 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.436137 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.497849 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.497813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-tls\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:08.500129 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.500101 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fe3d11c8-e168-4363-ab38-c45569cb532d-node-exporter-tls\") pod \"node-exporter-w5hs4\" (UID: \"fe3d11c8-e168-4363-ab38-c45569cb532d\") " pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:08.535800 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.535771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.636868 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.636831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.737931 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.737904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-w5hs4" Jun 15 01:59:08.751089 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:08.751058 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3d11c8_e168_4363_ab38_c45569cb532d.slice/crio-e0493637850763cfe28d3fbdacb0f10df46fced28c85e8bc2e633ddc0c4c3d0e WatchSource:0}: Error finding container e0493637850763cfe28d3fbdacb0f10df46fced28c85e8bc2e633ddc0c4c3d0e: Status 404 returned error can't find the container with id e0493637850763cfe28d3fbdacb0f10df46fced28c85e8bc2e633ddc0c4c3d0e Jun 15 01:59:08.769373 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.769341 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.858497 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.858461 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:08.868957 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.868925 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:59:08.872659 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.872637 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.875368 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 15 01:59:08.875368 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875362 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 15 01:59:08.875591 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875380 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 15 01:59:08.875591 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 15 01:59:08.875591 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875427 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 15 01:59:08.875591 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875388 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 15 01:59:08.875591 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 15 01:59:08.875845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875690 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5mvfx\"" Jun 15 01:59:08.875845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875736 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 15 01:59:08.875845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.875663 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 15 01:59:08.888219 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.888154 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:59:08.901179 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901342 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb5fg\" (UniqueName: \"kubernetes.io/projected/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-kube-api-access-kb5fg\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901342 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901342 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901499 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901499 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901499 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901499 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901480 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901732 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901513 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901732 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901732 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901732 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:08.901930 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:08.901764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002492 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002453 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002492 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb5fg\" (UniqueName: \"kubernetes.io/projected/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-kube-api-access-kb5fg\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002600 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.002764 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:09.002763 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-trusted-ca-bundle podName:b7b24eea-a9ac-4b24-9f97-8ac74476cf79 nodeName:}" failed. No retries permitted until 2026-06-15 01:59:09.502742414 +0000 UTC m=+64.086634210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "b7b24eea-a9ac-4b24-9f97-8ac74476cf79") : configmap references non-existent config key: ca-bundle.crt Jun 15 01:59:09.003105 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.003105 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.003105 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.003105 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.003105 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.002974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.003105 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.003015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.003393 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:09.003223 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 01:59:09.003393 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:09.003289 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls podName:b7b24eea-a9ac-4b24-9f97-8ac74476cf79 nodeName:}" failed. No retries permitted until 2026-06-15 01:59:09.503272636 +0000 UTC m=+64.087164418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b7b24eea-a9ac-4b24-9f97-8ac74476cf79") : secret "alertmanager-main-tls" not found Jun 15 01:59:09.003565 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.003523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.005649 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.005620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.005811 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.005789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.005885 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.005829 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.005935 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.005914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-web-config\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.006140 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.006120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-config-out\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.006194 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.006106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.006697 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.006676 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-config-volume\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.007220 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.007199 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.010340 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.010319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb5fg\" (UniqueName: \"kubernetes.io/projected/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-kube-api-access-kb5fg\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.063906 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.063855 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5hs4" event={"ID":"fe3d11c8-e168-4363-ab38-c45569cb532d","Type":"ContainerStarted","Data":"e0493637850763cfe28d3fbdacb0f10df46fced28c85e8bc2e633ddc0c4c3d0e"} Jun 15 01:59:09.065272 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.065241 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" event={"ID":"bfe81919-18ee-43eb-8c97-36f55fff7c9f","Type":"ContainerStarted","Data":"77f127d06f904ee90a0bf1cf027ee537cbcdeaf4511e99a4a5ac2ee247540b23"} Jun 15 01:59:09.407483 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.407448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:09.410335 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.410306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aee1abf3-5762-446d-8584-6ae78c73413d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-5xddx\" (UID: \"aee1abf3-5762-446d-8584-6ae78c73413d\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:09.508302 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.508267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.508473 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.508333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.508562 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:09.508463 2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 15 01:59:09.508629 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:09.508589 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls podName:b7b24eea-a9ac-4b24-9f97-8ac74476cf79 nodeName:}" failed. No retries permitted until 2026-06-15 01:59:10.508561779 +0000 UTC m=+65.092453574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b7b24eea-a9ac-4b24-9f97-8ac74476cf79") : secret "alertmanager-main-tls" not found Jun 15 01:59:09.509519 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.509485 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:09.550952 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.550916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" Jun 15 01:59:09.684732 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.684611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:09.939159 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:09.939064 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx"] Jun 15 01:59:09.945058 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:09.945026 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee1abf3_5762_446d_8584_6ae78c73413d.slice/crio-f5baa529e616aabf2ff22c9a07d327369840cad5f1cdff44dd2f7bd8cefcb19b WatchSource:0}: Error finding container f5baa529e616aabf2ff22c9a07d327369840cad5f1cdff44dd2f7bd8cefcb19b: Status 404 returned error can't find the container with id f5baa529e616aabf2ff22c9a07d327369840cad5f1cdff44dd2f7bd8cefcb19b Jun 15 01:59:10.071239 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.071205 2562 generic.go:356] "Generic (PLEG): container finished" podID="fe3d11c8-e168-4363-ab38-c45569cb532d" containerID="6e9e35be1cd9618b0d3a35e4a5b0bd7b9439acd81d8598a68a107c091b8ed3ca" exitCode=0 Jun 15 01:59:10.071349 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.071331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5hs4" event={"ID":"fe3d11c8-e168-4363-ab38-c45569cb532d","Type":"ContainerDied","Data":"6e9e35be1cd9618b0d3a35e4a5b0bd7b9439acd81d8598a68a107c091b8ed3ca"} Jun 15 01:59:10.073942 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.073881 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" event={"ID":"bfe81919-18ee-43eb-8c97-36f55fff7c9f","Type":"ContainerStarted","Data":"1b60e07722e608c10b58235573c75d828da2d1744b536f36a6563cda28957cea"} Jun 15 01:59:10.074020 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.073976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" event={"ID":"bfe81919-18ee-43eb-8c97-36f55fff7c9f","Type":"ContainerStarted","Data":"3476d7e78065ce424f89d35788768536a8b1e9f1844634f3b6d1b17c569cf3c8"} Jun 15 01:59:10.075957 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.075937 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" event={"ID":"aee1abf3-5762-446d-8584-6ae78c73413d","Type":"ContainerStarted","Data":"f5baa529e616aabf2ff22c9a07d327369840cad5f1cdff44dd2f7bd8cefcb19b"} Jun 15 01:59:10.446273 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.446169 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:10.446273 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.446226 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:10.450894 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.450873 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:10.515925 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.515887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:10.518272 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.518241 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b7b24eea-a9ac-4b24-9f97-8ac74476cf79-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b7b24eea-a9ac-4b24-9f97-8ac74476cf79\") " pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:10.676475 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.676438 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:10.685337 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.685308 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 15 01:59:10.767413 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.767383 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:10.771160 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.771131 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-57797d7685-qvvkx"] Jun 15 01:59:10.776280 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.776254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.778832 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.778786 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 01:59:10.778832 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.778829 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cffh4\"" Jun 15 01:59:10.778998 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.778801 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 01:59:10.779043 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.778998 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 01:59:10.779108 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.779092 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-a3s7eks9l04n4\"" Jun 15 01:59:10.779403 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.779244 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 01:59:10.779403 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.779294 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 01:59:10.789640 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.789510 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57797d7685-qvvkx"] Jun 15 01:59:10.818426 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818426 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818429 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-grpc-tls\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818667 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818487 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818667 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818667 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-tls\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818813 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818813 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818719 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-metrics-client-ca\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.818813 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.818772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74gk\" (UniqueName: \"kubernetes.io/projected/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-kube-api-access-f74gk\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.842223 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.842189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:10.850292 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.850261 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 15 01:59:10.854042 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:10.854011 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7b24eea_a9ac_4b24_9f97_8ac74476cf79.slice/crio-2e17bb917f3dc0732506a823e618962ef29da84338f40dd50dc8c39954a6c9b9 WatchSource:0}: Error finding container 2e17bb917f3dc0732506a823e618962ef29da84338f40dd50dc8c39954a6c9b9: Status 404 returned error can't find the container with id 2e17bb917f3dc0732506a823e618962ef29da84338f40dd50dc8c39954a6c9b9 Jun 15 01:59:10.920301 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.920267 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921030 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921184 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-tls\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921184 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921184 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-metrics-client-ca\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921427 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74gk\" (UniqueName: \"kubernetes.io/projected/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-kube-api-access-f74gk\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921427 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.921427 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.921302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-grpc-tls\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.924110 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.923944 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-metrics-client-ca\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.925780 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.925352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.926711 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.926233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.926952 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.926928 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.928651 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.928628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-grpc-tls\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.928841 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.928813 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.928931 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.928838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-secret-thanos-querier-tls\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:10.935144 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:10.935117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74gk\" (UniqueName: \"kubernetes.io/projected/64594edc-f52f-46b2-9e12-cd9ed1ec0fcd-kube-api-access-f74gk\") pod \"thanos-querier-57797d7685-qvvkx\" (UID: \"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd\") " pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:11.083489 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.083450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5hs4" event={"ID":"fe3d11c8-e168-4363-ab38-c45569cb532d","Type":"ContainerStarted","Data":"c1059108bccefba65f62eebadef4442abca571cc6af17516e52a995bb5e35f16"} Jun 15 01:59:11.083697 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.083586 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-w5hs4" event={"ID":"fe3d11c8-e168-4363-ab38-c45569cb532d","Type":"ContainerStarted","Data":"6578b85bdefa9183e8a9942d67267cc8b619ea8b26df9fb329504509d45f4726"} Jun 15 01:59:11.084949 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.084920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"2e17bb917f3dc0732506a823e618962ef29da84338f40dd50dc8c39954a6c9b9"} Jun 15 01:59:11.087491 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.087430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" event={"ID":"bfe81919-18ee-43eb-8c97-36f55fff7c9f","Type":"ContainerStarted","Data":"52e531e87b05a2e9752011fc1e90216e0c5cbe3f7cf76657e5dd35b8282c615c"} Jun 15 01:59:11.089699 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.089662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" event={"ID":"aee1abf3-5762-446d-8584-6ae78c73413d","Type":"ContainerStarted","Data":"610b5f70e1a024dfbf9d23e003df4d9e85aac6aaa57b497b78d7f2a528ebe575"} Jun 15 01:59:11.089799 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.089729 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" event={"ID":"aee1abf3-5762-446d-8584-6ae78c73413d","Type":"ContainerStarted","Data":"adba41d3fbec04e48b7543bc8dba07a4297f619ae7b6e6f8de2b37fd523e4a3e"} Jun 15 01:59:11.093422 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.093397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:11.094156 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.094138 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:11.100489 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.100428 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-w5hs4" podStartSLOduration=2.959407461 podStartE2EDuration="4.100415727s" totalImagesPullingTime="1.042063363s" totalInitContainerRuntime="98.944903ms" isStatefulPod=true podCreationTimestamp="2026-06-15 01:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:11.099779875 +0000 UTC m=+65.683671704" watchObservedRunningTime="2026-06-15 01:59:11.100415727 +0000 UTC m=+65.684307598" Jun 15 01:59:11.118259 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.118182 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6tmfp" podStartSLOduration=2.554581045 podStartE2EDuration="4.118160089s" totalImagesPullingTime="1.563579044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:11.117063911 +0000 UTC m=+65.700955730" watchObservedRunningTime="2026-06-15 01:59:11.118160089 +0000 UTC m=+65.702051892" Jun 15 01:59:11.251882 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.251844 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-57797d7685-qvvkx"] Jun 15 01:59:11.255958 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:11.255925 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64594edc_f52f_46b2_9e12_cd9ed1ec0fcd.slice/crio-94b302094b6f62ff7e9d8f213a39f3c96caafb69966be88c44304615d8c6e94b WatchSource:0}: Error finding container 94b302094b6f62ff7e9d8f213a39f3c96caafb69966be88c44304615d8c6e94b: Status 404 returned error can't find the container with id 94b302094b6f62ff7e9d8f213a39f3c96caafb69966be88c44304615d8c6e94b Jun 15 01:59:11.282037 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.282005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:11.382631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.382488 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:11.482874 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.482815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:11.530743 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.530711 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:11.628948 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.628915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:59:11.629132 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.628983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:59:11.631404 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.631377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 01:59:11.631558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.631377 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 01:59:11.641885 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.641817 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fe74fdac-c36b-4513-ab6b-a73ae892e085-original-pull-secret\") pod \"global-pull-secret-syncer-x9kcc\" (UID: \"fe74fdac-c36b-4513-ab6b-a73ae892e085\") " pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:59:11.642005 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.641942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67ff0471-0c24-4354-a459-310b8c44af0c-metrics-certs\") pod \"network-metrics-daemon-lxtkn\" (UID: \"67ff0471-0c24-4354-a459-310b8c44af0c\") " pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:59:11.729757 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.729717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:59:11.732164 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.732139 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 01:59:11.742674 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.742646 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 01:59:11.754751 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.754721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfhxf\" (UniqueName: \"kubernetes.io/projected/258f8df5-12d3-40c0-af2b-41326b3df1d8-kube-api-access-tfhxf\") pod \"network-check-target-8k9v2\" (UID: \"258f8df5-12d3-40c0-af2b-41326b3df1d8\") " pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:59:11.897360 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.897245 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9kcc" Jun 15 01:59:11.910906 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.910703 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2mckb\"" Jun 15 01:59:11.918609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.918571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:59:11.918764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.918750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rgn9m\"" Jun 15 01:59:11.926563 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:11.926521 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lxtkn" Jun 15 01:59:12.103005 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.102868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"94b302094b6f62ff7e9d8f213a39f3c96caafb69966be88c44304615d8c6e94b"} Jun 15 01:59:12.107684 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.107126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" event={"ID":"aee1abf3-5762-446d-8584-6ae78c73413d","Type":"ContainerStarted","Data":"5e167642f961e593d2356f9f2609f483652ab6a90deb6aaf835cf2381ef110bb"} Jun 15 01:59:12.129878 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.129820 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-5xddx" podStartSLOduration=4.114277692 podStartE2EDuration="5.129797372s" totalImagesPullingTime="1.01551968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:12.128593616 +0000 UTC m=+66.712485418" watchObservedRunningTime="2026-06-15 01:59:12.129797372 +0000 UTC m=+66.713689176" Jun 15 01:59:12.180104 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.180077 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7c786584c8-vwkhz"] Jun 15 01:59:12.187517 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.187494 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.191873 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.191395 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c786584c8-vwkhz"] Jun 15 01:59:12.192031 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.191883 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 01:59:12.192608 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.192126 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7814tpdslhvqp\"" Jun 15 01:59:12.192608 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.192196 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 01:59:12.192608 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.192352 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 01:59:12.192608 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.192432 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nmwlj\"" Jun 15 01:59:12.193631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.193193 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 01:59:12.211284 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.211257 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9kcc"] Jun 15 01:59:12.213461 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:12.213432 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe74fdac_c36b_4513_ab6b_a73ae892e085.slice/crio-d3bc368116c9191875eb61aa2faf06ef3df4097ae325b8327b811725fb5ba3f5 WatchSource:0}: Error finding container d3bc368116c9191875eb61aa2faf06ef3df4097ae325b8327b811725fb5ba3f5: Status 404 returned error can't find the container with id d3bc368116c9191875eb61aa2faf06ef3df4097ae325b8327b811725fb5ba3f5 Jun 15 01:59:12.222611 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.222302 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lxtkn"] Jun 15 01:59:12.225162 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:12.225133 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67ff0471_0c24_4354_a459_310b8c44af0c.slice/crio-d2b6a00f1cdd641ae5cee026f63d3582966ceda117362234ba482e1a97294a8a WatchSource:0}: Error finding container d2b6a00f1cdd641ae5cee026f63d3582966ceda117362234ba482e1a97294a8a: Status 404 returned error can't find the container with id d2b6a00f1cdd641ae5cee026f63d3582966ceda117362234ba482e1a97294a8a Jun 15 01:59:12.233608 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.233486 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-client-ca-bundle\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.233608 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.233581 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-secret-metrics-server-client-certs\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.233778 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.233627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d862747-b2c6-4668-83e6-83529336010a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.234226 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.234182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d862747-b2c6-4668-83e6-83529336010a-metrics-server-audit-profiles\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.235299 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.234461 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8bgn\" (UniqueName: \"kubernetes.io/projected/7d862747-b2c6-4668-83e6-83529336010a-kube-api-access-k8bgn\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.235299 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.234670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-secret-metrics-server-tls\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.235299 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.234708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d862747-b2c6-4668-83e6-83529336010a-audit-log\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.244990 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.244959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8k9v2"] Jun 15 01:59:12.274715 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:12.274670 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod258f8df5_12d3_40c0_af2b_41326b3df1d8.slice/crio-908a4a4aec5dfe332bcbab6c5fdefdaa0593a9d425b29bbb63cee84f4017550b WatchSource:0}: Error finding container 908a4a4aec5dfe332bcbab6c5fdefdaa0593a9d425b29bbb63cee84f4017550b: Status 404 returned error can't find the container with id 908a4a4aec5dfe332bcbab6c5fdefdaa0593a9d425b29bbb63cee84f4017550b Jun 15 01:59:12.336306 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-secret-metrics-server-tls\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336306 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d862747-b2c6-4668-83e6-83529336010a-audit-log\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336581 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-client-ca-bundle\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336581 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-secret-metrics-server-client-certs\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336581 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d862747-b2c6-4668-83e6-83529336010a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336730 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d862747-b2c6-4668-83e6-83529336010a-metrics-server-audit-profiles\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336730 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8bgn\" (UniqueName: \"kubernetes.io/projected/7d862747-b2c6-4668-83e6-83529336010a-kube-api-access-k8bgn\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.336927 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.336868 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d862747-b2c6-4668-83e6-83529336010a-audit-log\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.337313 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.337283 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d862747-b2c6-4668-83e6-83529336010a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.337837 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.337804 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d862747-b2c6-4668-83e6-83529336010a-metrics-server-audit-profiles\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.339395 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.339369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-secret-metrics-server-client-certs\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.339478 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.339457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-secret-metrics-server-tls\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.339602 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.339583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d862747-b2c6-4668-83e6-83529336010a-client-ca-bundle\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.344464 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.344444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8bgn\" (UniqueName: \"kubernetes.io/projected/7d862747-b2c6-4668-83e6-83529336010a-kube-api-access-k8bgn\") pod \"metrics-server-7c786584c8-vwkhz\" (UID: \"7d862747-b2c6-4668-83e6-83529336010a\") " pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.507460 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.507367 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:12.530082 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.530051 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:12.537332 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.537298 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2"] Jun 15 01:59:12.541358 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.541282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.544298 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.544274 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5m56m\"" Jun 15 01:59:12.544454 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.544318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 01:59:12.549520 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.549491 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2"] Jun 15 01:59:12.595390 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.595304 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:12.640109 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.639894 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c97face-7332-4dba-9b61-7b7ff87068d9-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-xtxm2\" (UID: \"4c97face-7332-4dba-9b61-7b7ff87068d9\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.640109 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.639945 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcdm6\" (UniqueName: \"kubernetes.io/projected/4c97face-7332-4dba-9b61-7b7ff87068d9-kube-api-access-vcdm6\") pod \"monitoring-plugin-589576dfc7-xtxm2\" (UID: \"4c97face-7332-4dba-9b61-7b7ff87068d9\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.675679 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.675642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7c786584c8-vwkhz"] Jun 15 01:59:12.679501 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:12.679463 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d862747_b2c6_4668_83e6_83529336010a.slice/crio-0f474260feb048ba4ead5dff590e03c58dc1b228000c2d49419475def0fe687d WatchSource:0}: Error finding container 0f474260feb048ba4ead5dff590e03c58dc1b228000c2d49419475def0fe687d: Status 404 returned error can't find the container with id 0f474260feb048ba4ead5dff590e03c58dc1b228000c2d49419475def0fe687d Jun 15 01:59:12.740192 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.740155 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:12.741091 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.740682 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c97face-7332-4dba-9b61-7b7ff87068d9-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-xtxm2\" (UID: \"4c97face-7332-4dba-9b61-7b7ff87068d9\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.741091 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.740730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcdm6\" (UniqueName: \"kubernetes.io/projected/4c97face-7332-4dba-9b61-7b7ff87068d9-kube-api-access-vcdm6\") pod \"monitoring-plugin-589576dfc7-xtxm2\" (UID: \"4c97face-7332-4dba-9b61-7b7ff87068d9\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.744691 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.744662 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4c97face-7332-4dba-9b61-7b7ff87068d9-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-xtxm2\" (UID: \"4c97face-7332-4dba-9b61-7b7ff87068d9\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.750869 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.750838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcdm6\" (UniqueName: \"kubernetes.io/projected/4c97face-7332-4dba-9b61-7b7ff87068d9-kube-api-access-vcdm6\") pod \"monitoring-plugin-589576dfc7-xtxm2\" (UID: \"4c97face-7332-4dba-9b61-7b7ff87068d9\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:12.856742 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.856695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:13.000134 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:12.999509 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp"] Jun 15 01:59:13.005058 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.004161 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.009039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.006935 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mz59m\"" Jun 15 01:59:13.009039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.007288 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 15 01:59:13.009039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.007585 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 15 01:59:13.009039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.007797 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 15 01:59:13.009039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.008112 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 15 01:59:13.009039 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.008322 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 15 01:59:13.014099 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.013912 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 15 01:59:13.023820 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.023734 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp"] Jun 15 01:59:13.035711 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.035653 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tf2dr" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.052970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-telemeter-client-tls\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053021 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjfws\" (UniqueName: \"kubernetes.io/projected/f7cf8024-b04d-4db5-a93e-63a78f4771d8-kube-api-access-tjfws\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053205 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-federate-client-tls\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-serving-certs-ca-bundle\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-metrics-client-ca\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.053521 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.053387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-secret-telemeter-client\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.115603 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.115412 2562 generic.go:356] "Generic (PLEG): container finished" podID="b7b24eea-a9ac-4b24-9f97-8ac74476cf79" containerID="4af006a7fedc2e12fa8c9eb08c7c77f984789778d3fa31bc99c7e19bed723b3f" exitCode=0 Jun 15 01:59:13.115603 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.115499 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerDied","Data":"4af006a7fedc2e12fa8c9eb08c7c77f984789778d3fa31bc99c7e19bed723b3f"} Jun 15 01:59:13.117421 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.117244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" event={"ID":"7d862747-b2c6-4668-83e6-83529336010a","Type":"ContainerStarted","Data":"0f474260feb048ba4ead5dff590e03c58dc1b228000c2d49419475def0fe687d"} Jun 15 01:59:13.119151 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.119099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8k9v2" event={"ID":"258f8df5-12d3-40c0-af2b-41326b3df1d8","Type":"ContainerStarted","Data":"908a4a4aec5dfe332bcbab6c5fdefdaa0593a9d425b29bbb63cee84f4017550b"} Jun 15 01:59:13.120576 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.120548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxtkn" event={"ID":"67ff0471-0c24-4354-a459-310b8c44af0c","Type":"ContainerStarted","Data":"d2b6a00f1cdd641ae5cee026f63d3582966ceda117362234ba482e1a97294a8a"} Jun 15 01:59:13.122088 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.122064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9kcc" event={"ID":"fe74fdac-c36b-4513-ab6b-a73ae892e085","Type":"ContainerStarted","Data":"d3bc368116c9191875eb61aa2faf06ef3df4097ae325b8327b811725fb5ba3f5"} Jun 15 01:59:13.149975 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.149908 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-secret-telemeter-client\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-telemeter-client-tls\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjfws\" (UniqueName: \"kubernetes.io/projected/f7cf8024-b04d-4db5-a93e-63a78f4771d8-kube-api-access-tjfws\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-federate-client-tls\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-serving-certs-ca-bundle\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.154455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-metrics-client-ca\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.155631 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.155229 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-metrics-client-ca\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.157035 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.156786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-serving-certs-ca-bundle\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.157681 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.157238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7cf8024-b04d-4db5-a93e-63a78f4771d8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.159091 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.159038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-secret-telemeter-client\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.159793 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.159766 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.159889 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.159842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-telemeter-client-tls\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.162203 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.162173 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f7cf8024-b04d-4db5-a93e-63a78f4771d8-federate-client-tls\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.164804 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.164741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjfws\" (UniqueName: \"kubernetes.io/projected/f7cf8024-b04d-4db5-a93e-63a78f4771d8-kube-api-access-tjfws\") pod \"telemeter-client-7f9cb4499d-r7ksp\" (UID: \"f7cf8024-b04d-4db5-a93e-63a78f4771d8\") " pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.199112 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.199034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:13.300380 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.300248 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:13.322850 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.322592 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" Jun 15 01:59:13.401503 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.401415 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:13.661809 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.661723 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dc8c45f4c-tsnkv"] Jun 15 01:59:13.665458 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.665430 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.676054 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.675980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc8c45f4c-tsnkv"] Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760464 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-service-ca\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-oauth-config\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmqfw\" (UniqueName: \"kubernetes.io/projected/d98990db-4532-4aa5-9c90-73114ae29a19-kube-api-access-lmqfw\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-serving-cert\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-trusted-ca-bundle\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-console-config\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.760845 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.760730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-oauth-serving-cert\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.861791 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-serving-cert\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.861856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-trusted-ca-bundle\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.861898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-console-config\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.861924 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-oauth-serving-cert\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.861984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-service-ca\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.862037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-oauth-config\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.863558 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.862082 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmqfw\" (UniqueName: \"kubernetes.io/projected/d98990db-4532-4aa5-9c90-73114ae29a19-kube-api-access-lmqfw\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.864024 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.863621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-oauth-serving-cert\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.866004 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.864476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-trusted-ca-bundle\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.866004 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.865037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-console-config\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.866004 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.865595 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-service-ca\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.869439 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.869409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-serving-cert\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.872363 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.871807 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-oauth-config\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.873115 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.873070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmqfw\" (UniqueName: \"kubernetes.io/projected/d98990db-4532-4aa5-9c90-73114ae29a19-kube-api-access-lmqfw\") pod \"console-6dc8c45f4c-tsnkv\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:13.929227 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.929097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:13.979249 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:13.978906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:14.017374 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.017263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:14.024139 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.021479 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:59:14.026358 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.026336 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.030193 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.031817 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.032123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.032316 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.032514 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.032777 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.032940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.033129 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.033263 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.033478 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.033670 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 01:59:14.034218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.034090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 01:59:14.035003 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.034378 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 01:59:14.035419 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.035174 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7d6i1q95is4pj\"" Jun 15 01:59:14.035578 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.035499 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 01:59:14.035919 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.035749 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m5bqx\"" Jun 15 01:59:14.042282 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.042173 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:59:14.090229 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.090162 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170334 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170444 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170561 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170602 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170685 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d71a602-7b23-4491-b222-9a90b0bafcf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d71a602-7b23-4491-b222-9a90b0bafcf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170774 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.173069 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170847 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.174158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170876 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-config\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.174158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.174158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.174158 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.170981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbgt7\" (UniqueName: \"kubernetes.io/projected/8d71a602-7b23-4491-b222-9a90b0bafcf1-kube-api-access-lbgt7\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.271975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-config\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbgt7\" (UniqueName: \"kubernetes.io/projected/8d71a602-7b23-4491-b222-9a90b0bafcf1-kube-api-access-lbgt7\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272184 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.273366 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.272996 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277320 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277408 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d71a602-7b23-4491-b222-9a90b0bafcf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d71a602-7b23-4491-b222-9a90b0bafcf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277662 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.277715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.278432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.281396 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.282052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.282690 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.282495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.284987 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.284526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.288382 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.286796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.288382 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.287438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8d71a602-7b23-4491-b222-9a90b0bafcf1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.291333 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.291210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbgt7\" (UniqueName: \"kubernetes.io/projected/8d71a602-7b23-4491-b222-9a90b0bafcf1-kube-api-access-lbgt7\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.292341 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.292293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.297032 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.296968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.311567 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.309908 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8d71a602-7b23-4491-b222-9a90b0bafcf1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.311567 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.311001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.313411 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.313351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.314015 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.313964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-web-config\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.314659 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.314621 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.315223 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.315146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-config\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.315610 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.315561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8d71a602-7b23-4491-b222-9a90b0bafcf1-config-out\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.318883 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.318763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.323265 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.323084 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8d71a602-7b23-4491-b222-9a90b0bafcf1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8d71a602-7b23-4491-b222-9a90b0bafcf1\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.358590 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.355476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:14.401280 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.401198 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2"] Jun 15 01:59:14.428208 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.427932 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dc8c45f4c-tsnkv"] Jun 15 01:59:14.435594 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:14.435561 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98990db_4532_4aa5_9c90_73114ae29a19.slice/crio-dee425742e8e56ca81fbe21f949c8e783e3bf96240c8f3cdf5026aa065fe300f WatchSource:0}: Error finding container dee425742e8e56ca81fbe21f949c8e783e3bf96240c8f3cdf5026aa065fe300f: Status 404 returned error can't find the container with id dee425742e8e56ca81fbe21f949c8e783e3bf96240c8f3cdf5026aa065fe300f Jun 15 01:59:14.462139 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.461726 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp"] Jun 15 01:59:14.471971 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:14.471711 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cf8024_b04d_4db5_a93e_63a78f4771d8.slice/crio-97caa8e618bd7dfd89e674fe265fb80c350569bdd09cafc39c643f1128ca11eb WatchSource:0}: Error finding container 97caa8e618bd7dfd89e674fe265fb80c350569bdd09cafc39c643f1128ca11eb: Status 404 returned error can't find the container with id 97caa8e618bd7dfd89e674fe265fb80c350569bdd09cafc39c643f1128ca11eb Jun 15 01:59:14.638680 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:14.638652 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 01:59:15.138673 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.137560 2562 generic.go:356] "Generic (PLEG): container finished" podID="8d71a602-7b23-4491-b222-9a90b0bafcf1" containerID="53b385cefe9389d24b399f58eac2bbcb71cc32511883b0a7537c72f31b9fe5a9" exitCode=0 Jun 15 01:59:15.138673 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.137653 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerDied","Data":"53b385cefe9389d24b399f58eac2bbcb71cc32511883b0a7537c72f31b9fe5a9"} Jun 15 01:59:15.138673 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.137729 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"b7c1f4f54088da2e6f8a0dd8eb61f805d8944283e38d9188e9c99438177edfa4"} Jun 15 01:59:15.141266 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.140657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc8c45f4c-tsnkv" event={"ID":"d98990db-4532-4aa5-9c90-73114ae29a19","Type":"ContainerStarted","Data":"deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88"} Jun 15 01:59:15.141266 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.140722 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc8c45f4c-tsnkv" event={"ID":"d98990db-4532-4aa5-9c90-73114ae29a19","Type":"ContainerStarted","Data":"dee425742e8e56ca81fbe21f949c8e783e3bf96240c8f3cdf5026aa065fe300f"} Jun 15 01:59:15.145504 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.145389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" event={"ID":"f7cf8024-b04d-4db5-a93e-63a78f4771d8","Type":"ContainerStarted","Data":"97caa8e618bd7dfd89e674fe265fb80c350569bdd09cafc39c643f1128ca11eb"} Jun 15 01:59:15.148764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.148133 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxtkn" event={"ID":"67ff0471-0c24-4354-a459-310b8c44af0c","Type":"ContainerStarted","Data":"60c5e12ae9eae7d3c23a23d12bc40b8120d49fe09275cf5db34ec5070855eb1d"} Jun 15 01:59:15.148764 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.148182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lxtkn" event={"ID":"67ff0471-0c24-4354-a459-310b8c44af0c","Type":"ContainerStarted","Data":"4743d1172b433eef9c07134af8c0f1af865ed8549bb66b47511bd072594fbfa0"} Jun 15 01:59:15.150455 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.150330 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" event={"ID":"4c97face-7332-4dba-9b61-7b7ff87068d9","Type":"ContainerStarted","Data":"b33ef50a0d40f23ef06898acacae3cf575e4bfc8a81ae0739e391d25da2888a5"} Jun 15 01:59:15.153411 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.153392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"e003f5a4a80e96e4a5429890cdc09a271025b89593405114bc268f329982150a"} Jun 15 01:59:15.153628 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.153611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"f7f64a8c5cb89adcdc455569845d9f2ebd683899ce6174c8624007f2dab4050c"} Jun 15 01:59:15.153830 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.153805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"71f6663dedc0ce4c64553115186dcdf54b71a9de827bc765dd00d82a9e84da85"} Jun 15 01:59:15.181273 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.180620 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dc8c45f4c-tsnkv" podStartSLOduration=2.180597881 podStartE2EDuration="2.180597881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:15.178915086 +0000 UTC m=+69.762806888" watchObservedRunningTime="2026-06-15 01:59:15.180597881 +0000 UTC m=+69.764489687" Jun 15 01:59:15.195095 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.193112 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lxtkn" podStartSLOduration=68.249523786 podStartE2EDuration="1m10.19309078s" totalImagesPullingTime="1.943566994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:15.192641903 +0000 UTC m=+69.776533707" watchObservedRunningTime="2026-06-15 01:59:15.19309078 +0000 UTC m=+69.776982583" Jun 15 01:59:15.273016 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.272899 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:15.373508 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:15.373432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:17.752157 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:17.752124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:17.806798 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:17.806751 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:18.220111 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:18.220014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:18.320727 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:18.320688 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:21.196304 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.196163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9kcc" event={"ID":"fe74fdac-c36b-4513-ab6b-a73ae892e085","Type":"ContainerStarted","Data":"270e6b28dafd8ad9ea2a10d020fa88f8d4e0b966817dba141a502ed3018d85a5"} Jun 15 01:59:21.202556 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.202440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" event={"ID":"4c97face-7332-4dba-9b61-7b7ff87068d9","Type":"ContainerStarted","Data":"4d59cc769fba98d9ff975f74e20b6dbfd742d47dc2e986a5208804962c799abc"} Jun 15 01:59:21.205644 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.205076 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:21.226068 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.225183 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" Jun 15 01:59:21.231277 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.231125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"20d84833ff166b1d23c32473efad772b46ac704f0589f3d646f7910468bccfd3"} Jun 15 01:59:21.231277 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.231210 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"c366987739ac657300213a8e7af5ec32537cb8c65f1c73794fb3a3250c7e0640"} Jun 15 01:59:21.240508 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.239649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8k9v2" event={"ID":"258f8df5-12d3-40c0-af2b-41326b3df1d8","Type":"ContainerStarted","Data":"2e9fc89df8809c3289410b9abf1c89e1663d2ee7f00f932b79a56e2b6f22b85c"} Jun 15 01:59:21.240508 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.239957 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xtxm2" podStartSLOduration=2.798278771 podStartE2EDuration="9.239941603s" totalImagesPullingTime="6.441662832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:21.237787961 +0000 UTC m=+75.821679785" watchObservedRunningTime="2026-06-15 01:59:21.239941603 +0000 UTC m=+75.823833407" Jun 15 01:59:21.240508 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.240134 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9kcc" podStartSLOduration=66.60017492 podStartE2EDuration="1m15.240125013s" totalImagesPullingTime="8.639950093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 01:58:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:21.217164765 +0000 UTC m=+75.801056568" watchObservedRunningTime="2026-06-15 01:59:21.240125013 +0000 UTC m=+75.824016816" Jun 15 01:59:21.240508 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.240194 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:59:21.246659 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.243666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"83b94836554f0558263ad37fe4c7b13985ff69ef4bd9a8fb15980d7da7fc1701"} Jun 15 01:59:21.248056 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.248032 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" event={"ID":"f7cf8024-b04d-4db5-a93e-63a78f4771d8","Type":"ContainerStarted","Data":"78df533cb5ccb283f41acd566a982143be3e2559e2dfe72381280a7cdeca834b"} Jun 15 01:59:21.248181 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.248090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" event={"ID":"f7cf8024-b04d-4db5-a93e-63a78f4771d8","Type":"ContainerStarted","Data":"4af583df8b8807ffcce6919c8bca97165cacdf69bfb993a51b24cfe1e8f95d8c"} Jun 15 01:59:21.254708 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.251224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"85de809a824d80754032e9164375e299e5994f8a6632c1a704918f0e15a849d0"} Jun 15 01:59:21.254708 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.251295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"500046c3c220f5082778915c18dbf1c5446d6c93db65786512c4a3ff6dc1d2ae"} Jun 15 01:59:21.256805 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.256420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" event={"ID":"7d862747-b2c6-4668-83e6-83529336010a","Type":"ContainerStarted","Data":"5a9dc3a7bbdcdd045b0c901ac81833513db0f0279875294d7c5166afbd7b746a"} Jun 15 01:59:21.277135 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.276896 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8k9v2" podStartSLOduration=67.698192394 podStartE2EDuration="1m16.276874557s" totalImagesPullingTime="8.578682163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:58:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:21.275325006 +0000 UTC m=+75.859216809" watchObservedRunningTime="2026-06-15 01:59:21.276874557 +0000 UTC m=+75.860766363" Jun 15 01:59:21.316696 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:21.316633 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" podStartSLOduration=1.1427132 podStartE2EDuration="9.316613077s" totalImagesPullingTime="8.173899877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:21.314284527 +0000 UTC m=+75.898176326" watchObservedRunningTime="2026-06-15 01:59:21.316613077 +0000 UTC m=+75.900504880" Jun 15 01:59:22.147598 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.147560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:22.242102 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.242067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:22.264661 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.264622 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"3ae6a51547c66e435c6408074c39c54d8cd28b3a5e0e8e059d45b4821b969450"} Jun 15 01:59:22.264852 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.264697 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"4b050e87263ea887070eb6fbfc140940f48154535fcf1116d09a3dc45cf4a54d"} Jun 15 01:59:22.264852 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.264734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"ce34e52f7dc26f8d21e007e1d76e197d16456383c3503cbf8ee97a130e3a7bd3"} Jun 15 01:59:22.264852 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.264770 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"c564ffd909656308dcb4271ea707c99cb704ed18cb9c891235efb67237ac89d1"} Jun 15 01:59:22.264852 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.264804 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8d71a602-7b23-4491-b222-9a90b0bafcf1","Type":"ContainerStarted","Data":"961208c7b63776b12a5d268bd3c37c108f00317ff804ae7ef2686a7d6d54669b"} Jun 15 01:59:22.266760 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.266728 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" event={"ID":"f7cf8024-b04d-4db5-a93e-63a78f4771d8","Type":"ContainerStarted","Data":"d8b55422f087997fe4a8ff47d3dbe818968b85fba48b101d28b2ae149e6b5b2c"} Jun 15 01:59:22.270216 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.270187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"411b38ce0d0af255e55b1a5647952ed50891b6df695aa288dcebcb31a513f7b1"} Jun 15 01:59:22.270367 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.270270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"16a9fa9ec292bfb9ba5396f2daa76754bfe781cfcca0edb3fd85a932de953ec8"} Jun 15 01:59:22.270367 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.270315 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"39315acb706c579da2cd18510efbe973890de14529f12394b7c972b13b9883f9"} Jun 15 01:59:22.270367 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.270348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b7b24eea-a9ac-4b24-9f97-8ac74476cf79","Type":"ContainerStarted","Data":"51c94e4ff3d03bd1754dc58611fc9404c5aea1c9ec2f06e3497103ce4549bab9"} Jun 15 01:59:22.273103 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.273081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" event={"ID":"64594edc-f52f-46b2-9e12-cd9ed1ec0fcd","Type":"ContainerStarted","Data":"5e6338c356d84c584e8de9caae98243b1eeecc7b81bd747d3b525b2fa7a9e247"} Jun 15 01:59:22.273772 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.273750 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:22.278826 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.278808 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" Jun 15 01:59:22.294323 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.294132 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.526091507 podStartE2EDuration="8.294112003s" totalImagesPullingTime="5.738117644s" totalInitContainerRuntime="29.902852ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:22.292508776 +0000 UTC m=+76.876400592" watchObservedRunningTime="2026-06-15 01:59:22.294112003 +0000 UTC m=+76.878004011" Jun 15 01:59:22.313962 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.313904 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-57797d7685-qvvkx" podStartSLOduration=3.212242011 podStartE2EDuration="12.313884224s" totalImagesPullingTime="9.101642213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:22.311347783 +0000 UTC m=+76.895239585" watchObservedRunningTime="2026-06-15 01:59:22.313884224 +0000 UTC m=+76.897776026" Jun 15 01:59:22.332459 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.332399 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f9cb4499d-r7ksp" podStartSLOduration=3.950445806 podStartE2EDuration="10.332379607s" totalImagesPullingTime="6.381933801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:22.33187038 +0000 UTC m=+76.915762203" watchObservedRunningTime="2026-06-15 01:59:22.332379607 +0000 UTC m=+76.916271412" Jun 15 01:59:22.358490 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:22.358375 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.383988804 podStartE2EDuration="14.358354898s" totalImagesPullingTime="8.954750429s" totalInitContainerRuntime="19.615665ms" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:22.35697063 +0000 UTC m=+76.940862432" watchObservedRunningTime="2026-06-15 01:59:22.358354898 +0000 UTC m=+76.942246702" Jun 15 01:59:23.279467 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.279431 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc8c45f4c-tsnkv"] Jun 15 01:59:23.313285 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.313254 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5844f8c497-gtsks"] Jun 15 01:59:23.317853 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.317830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.327988 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.327964 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5844f8c497-gtsks"] Jun 15 01:59:23.478238 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.478196 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-oauth-config\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.478505 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.478484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btkb9\" (UniqueName: \"kubernetes.io/projected/7dcd5b19-42c5-43b1-918f-fee57086a97d-kube-api-access-btkb9\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.478653 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.478639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-trusted-ca-bundle\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.478872 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.478852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-config\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.479088 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.479065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-serving-cert\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.479197 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.479103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-oauth-serving-cert\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.479197 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.479133 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-service-ca\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580464 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580425 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-config\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580649 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-serving-cert\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580649 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-oauth-serving-cert\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580649 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-service-ca\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580649 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-oauth-config\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580649 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580623 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btkb9\" (UniqueName: \"kubernetes.io/projected/7dcd5b19-42c5-43b1-918f-fee57086a97d-kube-api-access-btkb9\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.580905 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.580651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-trusted-ca-bundle\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.581354 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.581327 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-service-ca\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.581472 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.581375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-oauth-serving-cert\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.581472 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.581394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-config\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.581626 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.581497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-trusted-ca-bundle\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.583139 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.583110 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-serving-cert\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.583259 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.583141 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-oauth-config\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.587941 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.587920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btkb9\" (UniqueName: \"kubernetes.io/projected/7dcd5b19-42c5-43b1-918f-fee57086a97d-kube-api-access-btkb9\") pod \"console-5844f8c497-gtsks\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.627640 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.627605 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:23.760385 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.760360 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5844f8c497-gtsks"] Jun 15 01:59:23.763245 ip-10-0-139-93 kubenswrapper[2562]: W0615 01:59:23.763221 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcd5b19_42c5_43b1_918f_fee57086a97d.slice/crio-c8e9295c56a17a71640c9470a96b254ec76cde3e1335efb4efa7a9bcd6d103c3 WatchSource:0}: Error finding container c8e9295c56a17a71640c9470a96b254ec76cde3e1335efb4efa7a9bcd6d103c3: Status 404 returned error can't find the container with id c8e9295c56a17a71640c9470a96b254ec76cde3e1335efb4efa7a9bcd6d103c3 Jun 15 01:59:23.980181 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:23.980086 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:24.285614 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:24.285512 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844f8c497-gtsks" event={"ID":"7dcd5b19-42c5-43b1-918f-fee57086a97d","Type":"ContainerStarted","Data":"2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63"} Jun 15 01:59:24.285614 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:24.285588 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844f8c497-gtsks" event={"ID":"7dcd5b19-42c5-43b1-918f-fee57086a97d","Type":"ContainerStarted","Data":"c8e9295c56a17a71640c9470a96b254ec76cde3e1335efb4efa7a9bcd6d103c3"} Jun 15 01:59:24.302692 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:24.302637 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5844f8c497-gtsks" podStartSLOduration=1.302619844 podStartE2EDuration="1.302619844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 01:59:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 01:59:24.301294306 +0000 UTC m=+78.885186110" watchObservedRunningTime="2026-06-15 01:59:24.302619844 +0000 UTC m=+78.886511646" Jun 15 01:59:24.356421 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:24.356373 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 01:59:27.301702 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:27.301643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:27.402554 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:27.402462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:32.507548 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:32.507485 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:32.507944 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:32.507580 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:32.745472 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:32.745438 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:32.795369 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:32.795293 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:33.628133 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:33.628094 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:33.628646 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:33.628197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:33.632913 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:33.632891 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:34.331822 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:34.331788 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 01:59:34.374418 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:34.374386 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98759b5ff-ks5bb"] Jun 15 01:59:34.504786 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:34.504749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:34.579498 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:34.579465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:34.676951 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:34.676874 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:34.726955 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:34.726922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:36.760348 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:36.760315 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:36.860893 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:36.860863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:46.009037 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:46.008996 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:46.829408 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:46.829378 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lpxn5_0411f206-78c8-458a-a277-573b9a14615d/serve-healthcheck-canary/0.log" Jun 15 01:59:47.747746 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:47.747699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:47.801823 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:47.801771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:48.303594 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.303549 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6dc8c45f4c-tsnkv" podUID="d98990db-4532-4aa5-9c90-73114ae29a19" containerName="console" containerID="cri-o://deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88" gracePeriod=15 Jun 15 01:59:48.373732 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.373690 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:48.474813 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.474778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:48.558059 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.558005 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:48.576241 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.576213 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:48.619394 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619363 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-oauth-config\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619602 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619451 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-oauth-serving-cert\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619678 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619604 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-serving-cert\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619678 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619661 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-console-config\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619780 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619707 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmqfw\" (UniqueName: \"kubernetes.io/projected/d98990db-4532-4aa5-9c90-73114ae29a19-kube-api-access-lmqfw\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619780 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619741 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-service-ca\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619780 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619765 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-trusted-ca-bundle\") pod \"d98990db-4532-4aa5-9c90-73114ae29a19\" (UID: \"d98990db-4532-4aa5-9c90-73114ae29a19\") " Jun 15 01:59:48.619932 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.619842 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:48.620078 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.620047 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-console-config" (OuterVolumeSpecName: "console-config") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:48.620147 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.620109 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:48.620147 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.620109 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-service-ca" (OuterVolumeSpecName: "service-ca") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:48.620327 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.620308 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:48.621849 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.621823 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:59:48.622189 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.622166 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:59:48.622280 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.622207 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d98990db-4532-4aa5-9c90-73114ae29a19-kube-api-access-lmqfw" (OuterVolumeSpecName: "kube-api-access-lmqfw") pod "d98990db-4532-4aa5-9c90-73114ae29a19" (UID: "d98990db-4532-4aa5-9c90-73114ae29a19"). InnerVolumeSpecName "kube-api-access-lmqfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:59:48.720824 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.720787 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:48.720824 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.720819 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:48.720824 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.720829 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmqfw\" (UniqueName: \"kubernetes.io/projected/d98990db-4532-4aa5-9c90-73114ae29a19-kube-api-access-lmqfw\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:48.720824 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.720839 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:48.721088 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.720847 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d98990db-4532-4aa5-9c90-73114ae29a19-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:48.721088 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:48.720857 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d98990db-4532-4aa5-9c90-73114ae29a19-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:49.389916 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.389879 2562 generic.go:356] "Generic (PLEG): container finished" podID="d98990db-4532-4aa5-9c90-73114ae29a19" containerID="deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88" exitCode=0 Jun 15 01:59:49.390383 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.389922 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dc8c45f4c-tsnkv" Jun 15 01:59:49.390383 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.389941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc8c45f4c-tsnkv" event={"ID":"d98990db-4532-4aa5-9c90-73114ae29a19","Type":"ContainerDied","Data":"deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88"} Jun 15 01:59:49.390383 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.389989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dc8c45f4c-tsnkv" event={"ID":"d98990db-4532-4aa5-9c90-73114ae29a19","Type":"ContainerDied","Data":"dee425742e8e56ca81fbe21f949c8e783e3bf96240c8f3cdf5026aa065fe300f"} Jun 15 01:59:49.390383 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.390036 2562 scope.go:117] "RemoveContainer" containerID="deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88" Jun 15 01:59:49.399270 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.399253 2562 scope.go:117] "RemoveContainer" containerID="deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88" Jun 15 01:59:49.399553 ip-10-0-139-93 kubenswrapper[2562]: E0615 01:59:49.399519 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88\": container with ID starting with deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88 not found: ID does not exist" containerID="deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88" Jun 15 01:59:49.399594 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.399563 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88"} err="failed to get container status \"deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88\": rpc error: code = NotFound desc = could not find container \"deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88\": container with ID starting with deb41bb905aa7263dc996e1a9560f9b58808a47797ae14198facb4da2e7ecc88 not found: ID does not exist" Jun 15 01:59:49.411741 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.411715 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dc8c45f4c-tsnkv"] Jun 15 01:59:49.414401 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.414376 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dc8c45f4c-tsnkv"] Jun 15 01:59:49.786641 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:49.786554 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d98990db-4532-4aa5-9c90-73114ae29a19" path="/var/lib/kubelet/pods/d98990db-4532-4aa5-9c90-73114ae29a19/volumes" Jun 15 01:59:52.512967 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:52.512930 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:52.516864 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:52.516839 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7c786584c8-vwkhz" Jun 15 01:59:53.281614 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:53.281585 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8k9v2" Jun 15 01:59:59.401168 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.400956 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-98759b5ff-ks5bb" podUID="112b63a3-da51-432a-a0a2-d68c0e0ef324" containerName="console" containerID="cri-o://51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64" gracePeriod=15 Jun 15 01:59:59.426663 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.426626 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 01:59:59.682683 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.682338 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 01:59:59.827034 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827000 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-service-ca\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.827218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827059 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-config\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.827218 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827101 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-trusted-ca-bundle\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.827327 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827262 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-oauth-serving-cert\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.827380 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827344 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-serving-cert\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.827431 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827381 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx69r\" (UniqueName: \"kubernetes.io/projected/112b63a3-da51-432a-a0a2-d68c0e0ef324-kube-api-access-sx69r\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.827484 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827425 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-service-ca" (OuterVolumeSpecName: "service-ca") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:59.827484 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827433 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-config" (OuterVolumeSpecName: "console-config") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:59.827484 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827458 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:59.827484 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827463 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-oauth-config\") pod \"112b63a3-da51-432a-a0a2-d68c0e0ef324\" (UID: \"112b63a3-da51-432a-a0a2-d68c0e0ef324\") " Jun 15 01:59:59.830609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.827603 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 01:59:59.830609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.828464 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:59.830609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.828492 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:59.830609 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.828507 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:59.830950 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.830702 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:59:59.835642 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.835601 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 01:59:59.835824 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.835658 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/112b63a3-da51-432a-a0a2-d68c0e0ef324-kube-api-access-sx69r" (OuterVolumeSpecName: "kube-api-access-sx69r") pod "112b63a3-da51-432a-a0a2-d68c0e0ef324" (UID: "112b63a3-da51-432a-a0a2-d68c0e0ef324"). InnerVolumeSpecName "kube-api-access-sx69r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 01:59:59.929352 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.929270 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/112b63a3-da51-432a-a0a2-d68c0e0ef324-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:59.929352 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.929299 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:59.929352 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.929310 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx69r\" (UniqueName: \"kubernetes.io/projected/112b63a3-da51-432a-a0a2-d68c0e0ef324-kube-api-access-sx69r\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 01:59:59.929352 ip-10-0-139-93 kubenswrapper[2562]: I0615 01:59:59.929319 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/112b63a3-da51-432a-a0a2-d68c0e0ef324-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:00:00.440472 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.440432 2562 generic.go:356] "Generic (PLEG): container finished" podID="112b63a3-da51-432a-a0a2-d68c0e0ef324" containerID="51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64" exitCode=0 Jun 15 02:00:00.440927 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.440517 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98759b5ff-ks5bb" Jun 15 02:00:00.440927 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.440527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98759b5ff-ks5bb" event={"ID":"112b63a3-da51-432a-a0a2-d68c0e0ef324","Type":"ContainerDied","Data":"51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64"} Jun 15 02:00:00.440927 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.440657 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98759b5ff-ks5bb" event={"ID":"112b63a3-da51-432a-a0a2-d68c0e0ef324","Type":"ContainerDied","Data":"c37042b8ae03523a3e47d76666069d2323237b3ae6cdfde8eae8dffa8f86cacf"} Jun 15 02:00:00.440927 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.440682 2562 scope.go:117] "RemoveContainer" containerID="51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64" Jun 15 02:00:00.450106 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.450088 2562 scope.go:117] "RemoveContainer" containerID="51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64" Jun 15 02:00:00.451131 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:00:00.450682 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64\": container with ID starting with 51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64 not found: ID does not exist" containerID="51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64" Jun 15 02:00:00.451131 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.450727 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64"} err="failed to get container status \"51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64\": rpc error: code = NotFound desc = could not find container \"51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64\": container with ID starting with 51a4a383a45b5e2b4c25bcec2af87911c51be30ffab3781e81646b28ef4baf64 not found: ID does not exist" Jun 15 02:00:00.465901 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.464272 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98759b5ff-ks5bb"] Jun 15 02:00:00.468118 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:00.468075 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98759b5ff-ks5bb"] Jun 15 02:00:01.786704 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:01.786674 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="112b63a3-da51-432a-a0a2-d68c0e0ef324" path="/var/lib/kubelet/pods/112b63a3-da51-432a-a0a2-d68c0e0ef324/volumes" Jun 15 02:00:14.356607 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:14.356552 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:00:14.376066 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:14.376039 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:00:14.512583 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:14.512554 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 02:00:19.512695 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:19.512660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:23.825103 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:23.825068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:23.874001 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:23.873963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:25.732611 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:25.732572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:25.781107 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:25.781065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:35.697979 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:35.697944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:35.798418 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:35.798384 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:36.967431 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:36.967387 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5844f8c497-gtsks"] Jun 15 02:00:37.055979 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:37.055944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:37.161661 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:37.161626 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:37.211469 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:37.211439 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:47.757972 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:47.757891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:00:47.859614 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:00:47.859577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:01.987848 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:01.987781 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5844f8c497-gtsks" podUID="7dcd5b19-42c5-43b1-918f-fee57086a97d" containerName="console" containerID="cri-o://2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63" gracePeriod=15 Jun 15 02:01:02.237736 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.237706 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 02:01:02.279696 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279610 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-oauth-config\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.279696 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279648 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-oauth-serving-cert\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.279696 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279696 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-trusted-ca-bundle\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.279974 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279851 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-service-ca\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.279974 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279890 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-serving-cert\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.279974 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279946 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btkb9\" (UniqueName: \"kubernetes.io/projected/7dcd5b19-42c5-43b1-918f-fee57086a97d-kube-api-access-btkb9\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.279974 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.279962 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-config\") pod \"7dcd5b19-42c5-43b1-918f-fee57086a97d\" (UID: \"7dcd5b19-42c5-43b1-918f-fee57086a97d\") " Jun 15 02:01:02.280175 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.280093 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:01:02.280175 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.280111 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:01:02.280263 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.280199 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-service-ca" (OuterVolumeSpecName: "service-ca") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:01:02.280263 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.280232 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-oauth-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.280263 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.280250 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-trusted-ca-bundle\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.280462 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.280439 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-config" (OuterVolumeSpecName: "console-config") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 02:01:02.281879 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.281845 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:01:02.282073 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.282045 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:01:02.282145 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.282100 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcd5b19-42c5-43b1-918f-fee57086a97d-kube-api-access-btkb9" (OuterVolumeSpecName: "kube-api-access-btkb9") pod "7dcd5b19-42c5-43b1-918f-fee57086a97d" (UID: "7dcd5b19-42c5-43b1-918f-fee57086a97d"). InnerVolumeSpecName "kube-api-access-btkb9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:01:02.381057 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.381020 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-oauth-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.381057 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.381051 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-service-ca\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.381057 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.381059 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-serving-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.381057 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.381068 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btkb9\" (UniqueName: \"kubernetes.io/projected/7dcd5b19-42c5-43b1-918f-fee57086a97d-kube-api-access-btkb9\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.381326 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.381078 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7dcd5b19-42c5-43b1-918f-fee57086a97d-console-config\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:01:02.688341 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.688310 2562 generic.go:356] "Generic (PLEG): container finished" podID="7dcd5b19-42c5-43b1-918f-fee57086a97d" containerID="2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63" exitCode=0 Jun 15 02:01:02.688580 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.688366 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5844f8c497-gtsks" Jun 15 02:01:02.688580 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.688389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844f8c497-gtsks" event={"ID":"7dcd5b19-42c5-43b1-918f-fee57086a97d","Type":"ContainerDied","Data":"2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63"} Jun 15 02:01:02.688580 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.688431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5844f8c497-gtsks" event={"ID":"7dcd5b19-42c5-43b1-918f-fee57086a97d","Type":"ContainerDied","Data":"c8e9295c56a17a71640c9470a96b254ec76cde3e1335efb4efa7a9bcd6d103c3"} Jun 15 02:01:02.688580 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.688450 2562 scope.go:117] "RemoveContainer" containerID="2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63" Jun 15 02:01:02.697078 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.697062 2562 scope.go:117] "RemoveContainer" containerID="2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63" Jun 15 02:01:02.697324 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:01:02.697308 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63\": container with ID starting with 2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63 not found: ID does not exist" containerID="2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63" Jun 15 02:01:02.697385 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.697330 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63"} err="failed to get container status \"2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63\": rpc error: code = NotFound desc = could not find container \"2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63\": container with ID starting with 2f67a9f42eb485cd8450f71285fde2a9dcf9b173e194b6284aeb77fe86c34a63 not found: ID does not exist" Jun 15 02:01:02.708833 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.708809 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5844f8c497-gtsks"] Jun 15 02:01:02.713888 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:02.713866 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5844f8c497-gtsks"] Jun 15 02:01:03.786257 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:03.786225 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dcd5b19-42c5-43b1-918f-fee57086a97d" path="/var/lib/kubelet/pods/7dcd5b19-42c5-43b1-918f-fee57086a97d/volumes" Jun 15 02:01:16.880814 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:16.880779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:16.982055 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:16.982018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:22.225552 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:22.225496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:22.325997 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:22.325965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:26.166651 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:26.166611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:26.218760 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:26.218724 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:48.758734 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:48.758698 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:49.524952 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:49.524918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:52.370697 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:52.370662 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:52.423806 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:52.423770 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:55.080732 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:55.080694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:55.196290 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:55.196257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:55.631980 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:55.631947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:55.737332 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:55.737302 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:56.900280 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900243 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2"] Jun 15 02:01:56.900663 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900595 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d98990db-4532-4aa5-9c90-73114ae29a19" containerName="console" Jun 15 02:01:56.900663 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900607 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d98990db-4532-4aa5-9c90-73114ae29a19" containerName="console" Jun 15 02:01:56.900663 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900616 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcd5b19-42c5-43b1-918f-fee57086a97d" containerName="console" Jun 15 02:01:56.900663 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900622 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcd5b19-42c5-43b1-918f-fee57086a97d" containerName="console" Jun 15 02:01:56.900663 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900636 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="112b63a3-da51-432a-a0a2-d68c0e0ef324" containerName="console" Jun 15 02:01:56.900663 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900642 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="112b63a3-da51-432a-a0a2-d68c0e0ef324" containerName="console" Jun 15 02:01:56.900847 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900690 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d98990db-4532-4aa5-9c90-73114ae29a19" containerName="console" Jun 15 02:01:56.900847 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900699 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcd5b19-42c5-43b1-918f-fee57086a97d" containerName="console" Jun 15 02:01:56.900847 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.900708 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="112b63a3-da51-432a-a0a2-d68c0e0ef324" containerName="console" Jun 15 02:01:56.903862 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.903837 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:56.906462 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.906439 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 15 02:01:56.907433 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.907412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 15 02:01:56.907617 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.907487 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-g4nm4\"" Jun 15 02:01:56.914528 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.914500 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2"] Jun 15 02:01:56.968738 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.968698 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc48r\" (UniqueName: \"kubernetes.io/projected/71d7237d-c437-477a-9447-b668f2d481ec-kube-api-access-pc48r\") pod \"cert-manager-webhook-7dc76cbb94-6mhq2\" (UID: \"71d7237d-c437-477a-9447-b668f2d481ec\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:56.968921 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:56.968785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d7237d-c437-477a-9447-b668f2d481ec-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6mhq2\" (UID: \"71d7237d-c437-477a-9447-b668f2d481ec\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:57.069985 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.069944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d7237d-c437-477a-9447-b668f2d481ec-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6mhq2\" (UID: \"71d7237d-c437-477a-9447-b668f2d481ec\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:57.070167 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.070040 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc48r\" (UniqueName: \"kubernetes.io/projected/71d7237d-c437-477a-9447-b668f2d481ec-kube-api-access-pc48r\") pod \"cert-manager-webhook-7dc76cbb94-6mhq2\" (UID: \"71d7237d-c437-477a-9447-b668f2d481ec\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:57.078194 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.078157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/71d7237d-c437-477a-9447-b668f2d481ec-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-6mhq2\" (UID: \"71d7237d-c437-477a-9447-b668f2d481ec\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:57.078333 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.078276 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc48r\" (UniqueName: \"kubernetes.io/projected/71d7237d-c437-477a-9447-b668f2d481ec-kube-api-access-pc48r\") pod \"cert-manager-webhook-7dc76cbb94-6mhq2\" (UID: \"71d7237d-c437-477a-9447-b668f2d481ec\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:57.222810 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.222724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:01:57.351497 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.351444 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2"] Jun 15 02:01:57.354239 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:01:57.354211 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71d7237d_c437_477a_9447_b668f2d481ec.slice/crio-25c8280a4af2690376351dde71e33d8789f6976534dbdcce57579ae209d6affd WatchSource:0}: Error finding container 25c8280a4af2690376351dde71e33d8789f6976534dbdcce57579ae209d6affd: Status 404 returned error can't find the container with id 25c8280a4af2690376351dde71e33d8789f6976534dbdcce57579ae209d6affd Jun 15 02:01:57.912773 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:57.912735 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" event={"ID":"71d7237d-c437-477a-9447-b668f2d481ec","Type":"ContainerStarted","Data":"25c8280a4af2690376351dde71e33d8789f6976534dbdcce57579ae209d6affd"} Jun 15 02:01:58.368876 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:58.368831 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:58.465672 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:58.465642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:01:58.977705 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:01:58.977671 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:05.756245 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:05.756212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:05.826512 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:05.826480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:05.946002 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:05.945968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" event={"ID":"71d7237d-c437-477a-9447-b668f2d481ec","Type":"ContainerStarted","Data":"d317e0286d7db83a828e3f3961372295c29af4efba9559d060cb3246cf5953f6"} Jun 15 02:02:05.946162 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:05.946059 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:02:05.962395 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:05.962343 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" podStartSLOduration=1.805755011 podStartE2EDuration="9.962327303s" totalImagesPullingTime="8.156572292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:02:05.961678201 +0000 UTC m=+240.545570003" watchObservedRunningTime="2026-06-15 02:02:05.962327303 +0000 UTC m=+240.546219083" Jun 15 02:02:06.777666 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:06.777633 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:11.952322 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:11.952287 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-6mhq2" Jun 15 02:02:15.633358 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.633266 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-n2q98"] Jun 15 02:02:15.636731 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.636707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.639604 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.639580 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9r88c\"" Jun 15 02:02:15.643723 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.643700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-n2q98"] Jun 15 02:02:15.734865 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.734827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfc6z\" (UniqueName: \"kubernetes.io/projected/30c78b6b-9713-4cf0-b1c9-88555b67efdc-kube-api-access-dfc6z\") pod \"cert-manager-59c77684cc-n2q98\" (UID: \"30c78b6b-9713-4cf0-b1c9-88555b67efdc\") " pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.735035 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.734877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30c78b6b-9713-4cf0-b1c9-88555b67efdc-bound-sa-token\") pod \"cert-manager-59c77684cc-n2q98\" (UID: \"30c78b6b-9713-4cf0-b1c9-88555b67efdc\") " pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.836001 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.835966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfc6z\" (UniqueName: \"kubernetes.io/projected/30c78b6b-9713-4cf0-b1c9-88555b67efdc-kube-api-access-dfc6z\") pod \"cert-manager-59c77684cc-n2q98\" (UID: \"30c78b6b-9713-4cf0-b1c9-88555b67efdc\") " pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.836182 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.836022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30c78b6b-9713-4cf0-b1c9-88555b67efdc-bound-sa-token\") pod \"cert-manager-59c77684cc-n2q98\" (UID: \"30c78b6b-9713-4cf0-b1c9-88555b67efdc\") " pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.845150 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.845120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30c78b6b-9713-4cf0-b1c9-88555b67efdc-bound-sa-token\") pod \"cert-manager-59c77684cc-n2q98\" (UID: \"30c78b6b-9713-4cf0-b1c9-88555b67efdc\") " pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.845314 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.845297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfc6z\" (UniqueName: \"kubernetes.io/projected/30c78b6b-9713-4cf0-b1c9-88555b67efdc-kube-api-access-dfc6z\") pod \"cert-manager-59c77684cc-n2q98\" (UID: \"30c78b6b-9713-4cf0-b1c9-88555b67efdc\") " pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:15.946384 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:15.946277 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-n2q98" Jun 15 02:02:16.078508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:16.078472 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-n2q98"] Jun 15 02:02:16.081466 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:02:16.081438 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30c78b6b_9713_4cf0_b1c9_88555b67efdc.slice/crio-8a8c77d609d617a7fc69c5235b118342f513c6a38318d5eee5ba3236e6930249 WatchSource:0}: Error finding container 8a8c77d609d617a7fc69c5235b118342f513c6a38318d5eee5ba3236e6930249: Status 404 returned error can't find the container with id 8a8c77d609d617a7fc69c5235b118342f513c6a38318d5eee5ba3236e6930249 Jun 15 02:02:16.897650 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:16.897611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:16.992193 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:16.992159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:16.992193 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:16.992192 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-n2q98" event={"ID":"30c78b6b-9713-4cf0-b1c9-88555b67efdc","Type":"ContainerStarted","Data":"c9a8523f70a1c48a500d7d3910294a386b11a6f30c75a8515a832fc8af2e5cf6"} Jun 15 02:02:16.992402 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:16.992229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-n2q98" event={"ID":"30c78b6b-9713-4cf0-b1c9-88555b67efdc","Type":"ContainerStarted","Data":"8a8c77d609d617a7fc69c5235b118342f513c6a38318d5eee5ba3236e6930249"} Jun 15 02:02:17.009025 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:17.008969 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-n2q98" podStartSLOduration=2.008952505 podStartE2EDuration="2.008952505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:02:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:02:17.007211574 +0000 UTC m=+251.591103389" watchObservedRunningTime="2026-06-15 02:02:17.008952505 +0000 UTC m=+251.592844306" Jun 15 02:02:23.044669 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:23.044635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:23.145204 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:23.145171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:24.808653 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:24.808613 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:25.000574 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:25.000521 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:25.048746 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:25.048712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:36.962993 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:36.962952 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:37.016670 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.016634 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c55858464-rbglx"] Jun 15 02:02:37.020181 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.020156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.022740 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.022719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 02:02:37.022878 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.022747 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 02:02:37.023898 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.023871 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 02:02:37.024023 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.023973 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 02:02:37.024090 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.024021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-lw9qj\"" Jun 15 02:02:37.026567 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.024515 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 02:02:37.032515 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.032480 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c55858464-rbglx"] Jun 15 02:02:37.042028 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.041996 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:37.119435 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.119394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/037138f2-a341-4220-aa07-754af61358c3-cert\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.119656 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.119452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2btk\" (UniqueName: \"kubernetes.io/projected/037138f2-a341-4220-aa07-754af61358c3-kube-api-access-d2btk\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.119656 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.119474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/037138f2-a341-4220-aa07-754af61358c3-metrics-cert\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.119656 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.119634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/037138f2-a341-4220-aa07-754af61358c3-manager-config\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.221094 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.221007 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/037138f2-a341-4220-aa07-754af61358c3-cert\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.221094 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.221060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2btk\" (UniqueName: \"kubernetes.io/projected/037138f2-a341-4220-aa07-754af61358c3-kube-api-access-d2btk\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.221094 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.221078 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/037138f2-a341-4220-aa07-754af61358c3-metrics-cert\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.221328 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.221118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/037138f2-a341-4220-aa07-754af61358c3-manager-config\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.221831 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.221809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/037138f2-a341-4220-aa07-754af61358c3-manager-config\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.223572 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.223523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/037138f2-a341-4220-aa07-754af61358c3-cert\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.223659 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.223602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/037138f2-a341-4220-aa07-754af61358c3-metrics-cert\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.228761 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.228735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2btk\" (UniqueName: \"kubernetes.io/projected/037138f2-a341-4220-aa07-754af61358c3-kube-api-access-d2btk\") pod \"lws-controller-manager-7c55858464-rbglx\" (UID: \"037138f2-a341-4220-aa07-754af61358c3\") " pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.336018 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.335972 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:37.476112 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:37.476015 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c55858464-rbglx"] Jun 15 02:02:37.480725 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:02:37.480691 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037138f2_a341_4220_aa07_754af61358c3.slice/crio-19bd4047bff5b52e16bc3674a5d9aa345f9f488b38ee77830e552ac3ff5715be WatchSource:0}: Error finding container 19bd4047bff5b52e16bc3674a5d9aa345f9f488b38ee77830e552ac3ff5715be: Status 404 returned error can't find the container with id 19bd4047bff5b52e16bc3674a5d9aa345f9f488b38ee77830e552ac3ff5715be Jun 15 02:02:38.085720 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:38.085660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" event={"ID":"037138f2-a341-4220-aa07-754af61358c3","Type":"ContainerStarted","Data":"19bd4047bff5b52e16bc3674a5d9aa345f9f488b38ee77830e552ac3ff5715be"} Jun 15 02:02:40.448445 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:40.448413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:41.101469 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.101439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" event={"ID":"037138f2-a341-4220-aa07-754af61358c3","Type":"ContainerStarted","Data":"2bf68fae2a343404600548d6f88df8933d55d24cb837f9242de2fb454c7ec03d"} Jun 15 02:02:41.101664 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.101500 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:41.117646 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.117563 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" podStartSLOduration=2.569493546 podStartE2EDuration="5.117517613s" totalImagesPullingTime="2.548024067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:02:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:02:41.117063931 +0000 UTC m=+275.700955733" watchObservedRunningTime="2026-06-15 02:02:41.117517613 +0000 UTC m=+275.701409415" Jun 15 02:02:41.384516 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.384430 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n"] Jun 15 02:02:41.388077 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.388059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.392654 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.392631 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 02:02:41.393087 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.393054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 02:02:41.393202 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.393122 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 02:02:41.393202 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.393144 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 02:02:41.395418 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.395402 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-79xzg\"" Jun 15 02:02:41.406675 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.406642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n"] Jun 15 02:02:41.461427 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.461389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cac5a863-2f56-495d-aa20-1c1f4a5e709b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.461861 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.461440 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pwcc\" (UniqueName: \"kubernetes.io/projected/cac5a863-2f56-495d-aa20-1c1f4a5e709b-kube-api-access-9pwcc\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.461861 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.461469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cac5a863-2f56-495d-aa20-1c1f4a5e709b-manifests\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.461861 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.461524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cac5a863-2f56-495d-aa20-1c1f4a5e709b-tmp\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.461861 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.461614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cac5a863-2f56-495d-aa20-1c1f4a5e709b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.535715 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.535682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:41.562454 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.562422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cac5a863-2f56-495d-aa20-1c1f4a5e709b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.562606 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.562470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pwcc\" (UniqueName: \"kubernetes.io/projected/cac5a863-2f56-495d-aa20-1c1f4a5e709b-kube-api-access-9pwcc\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.562606 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.562587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cac5a863-2f56-495d-aa20-1c1f4a5e709b-manifests\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.562722 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.562619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cac5a863-2f56-495d-aa20-1c1f4a5e709b-tmp\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.562722 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.562669 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cac5a863-2f56-495d-aa20-1c1f4a5e709b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.562990 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.562968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cac5a863-2f56-495d-aa20-1c1f4a5e709b-manifests\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.564737 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.564714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cac5a863-2f56-495d-aa20-1c1f4a5e709b-tmp\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.564960 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.564941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cac5a863-2f56-495d-aa20-1c1f4a5e709b-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.565024 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.564987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cac5a863-2f56-495d-aa20-1c1f4a5e709b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.571677 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.571654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pwcc\" (UniqueName: \"kubernetes.io/projected/cac5a863-2f56-495d-aa20-1c1f4a5e709b-kube-api-access-9pwcc\") pod \"opendatahub-operator-controller-manager-5f9f678f6b-mtg2n\" (UID: \"cac5a863-2f56-495d-aa20-1c1f4a5e709b\") " pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.633761 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.633728 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:41.699155 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.699073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:41.734144 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.734113 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:41.804937 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.804892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:41.844205 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.844157 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n"] Jun 15 02:02:41.846548 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:02:41.846509 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcac5a863_2f56_495d_aa20_1c1f4a5e709b.slice/crio-8776e81046d04d6ab7d84377e5709c870a7ff89e8bc9da9e53af517c2b23307e WatchSource:0}: Error finding container 8776e81046d04d6ab7d84377e5709c870a7ff89e8bc9da9e53af517c2b23307e: Status 404 returned error can't find the container with id 8776e81046d04d6ab7d84377e5709c870a7ff89e8bc9da9e53af517c2b23307e Jun 15 02:02:41.866027 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.865972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:41.964771 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:41.964653 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:42.064496 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:42.064453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:42.107236 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:42.107207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" event={"ID":"cac5a863-2f56-495d-aa20-1c1f4a5e709b","Type":"ContainerStarted","Data":"8776e81046d04d6ab7d84377e5709c870a7ff89e8bc9da9e53af517c2b23307e"} Jun 15 02:02:42.165578 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:42.165513 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:42.269767 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:42.269667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:02:45.124410 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:45.124371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" event={"ID":"cac5a863-2f56-495d-aa20-1c1f4a5e709b","Type":"ContainerStarted","Data":"e1f0518bc8c570b3f79dda506af3e35e32efb3690ce97b7cfabf5011938645f2"} Jun 15 02:02:46.130242 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:46.130205 2562 generic.go:356] "Generic (PLEG): container finished" podID="cac5a863-2f56-495d-aa20-1c1f4a5e709b" containerID="e1f0518bc8c570b3f79dda506af3e35e32efb3690ce97b7cfabf5011938645f2" exitCode=0 Jun 15 02:02:46.130769 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:46.130265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" event={"ID":"cac5a863-2f56-495d-aa20-1c1f4a5e709b","Type":"ContainerDied","Data":"e1f0518bc8c570b3f79dda506af3e35e32efb3690ce97b7cfabf5011938645f2"} Jun 15 02:02:47.136967 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:47.136935 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" event={"ID":"cac5a863-2f56-495d-aa20-1c1f4a5e709b","Type":"ContainerStarted","Data":"bc93d5907af1cf395936141b38b2f7acaca1713b52dd9fec265e24c5b887c26e"} Jun 15 02:02:47.137346 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:47.137046 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:02:47.158806 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:47.158653 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" podStartSLOduration=1.990562953 podStartE2EDuration="6.158631934s" totalImagesPullingTime="3.186025031s" totalInitContainerRuntime="982.04395ms" isStatefulPod=false podCreationTimestamp="2026-06-15 02:02:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:02:47.157036827 +0000 UTC m=+281.740928650" watchObservedRunningTime="2026-06-15 02:02:47.158631934 +0000 UTC m=+281.742523737" Jun 15 02:02:52.109547 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:52.109498 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c55858464-rbglx" Jun 15 02:02:58.143879 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:02:58.143845 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f9f678f6b-mtg2n" Jun 15 02:03:00.143927 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:00.143891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:00.253055 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:00.253017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:05.741207 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:05.741170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:05.744802 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:05.744776 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 02:03:05.746058 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:05.746034 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 02:03:05.752065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:05.752028 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 02:03:05.841138 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:05.841107 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:05.942775 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:05.942717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.097906 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.097868 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd"] Jun 15 02:03:06.101827 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.101804 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.104368 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.104337 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 02:03:06.104368 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.104361 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 02:03:06.104589 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.104445 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 02:03:06.105427 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.105372 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 02:03:06.105618 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.105599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6868q\"" Jun 15 02:03:06.108596 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.108518 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd"] Jun 15 02:03:06.154390 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.154354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.189395 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.187564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrthh\" (UniqueName: \"kubernetes.io/projected/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-kube-api-access-lrthh\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.189395 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.187699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-tmp\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.189395 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.187789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-tls-certs\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.263935 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.263900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.289264 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.289224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-tmp\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.289459 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.289286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-tls-certs\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.289459 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.289328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrthh\" (UniqueName: \"kubernetes.io/projected/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-kube-api-access-lrthh\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.292081 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.292055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-tmp\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.292344 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.292302 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-tls-certs\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.300972 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.300942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrthh\" (UniqueName: \"kubernetes.io/projected/79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44-kube-api-access-lrthh\") pod \"kube-auth-proxy-5d8986dff5-wlpqd\" (UID: \"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44\") " pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.314741 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.314708 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.369628 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.369524 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.412831 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.412795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" Jun 15 02:03:06.470957 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.470746 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.552217 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.552189 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd"] Jun 15 02:03:06.555277 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:03:06.555252 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79a7c1e0_23d9_47c9_9e5b_d4f5e78aeb44.slice/crio-6072bcc1369c41b7f05b630cfdd1833d6567dd53824efff6a4d9fd85c6ea3651 WatchSource:0}: Error finding container 6072bcc1369c41b7f05b630cfdd1833d6567dd53824efff6a4d9fd85c6ea3651: Status 404 returned error can't find the container with id 6072bcc1369c41b7f05b630cfdd1833d6567dd53824efff6a4d9fd85c6ea3651 Jun 15 02:03:06.851115 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.851081 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:06.922054 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:06.922018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:07.038355 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:07.038312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:07.231278 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:07.231172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" event={"ID":"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44","Type":"ContainerStarted","Data":"6072bcc1369c41b7f05b630cfdd1833d6567dd53824efff6a4d9fd85c6ea3651"} Jun 15 02:03:10.248186 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:10.248151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" event={"ID":"79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44","Type":"ContainerStarted","Data":"19f5f3013ef3812936e2a7c27cf8d4738c548fd017caaf7a7f57708e7cccef7f"} Jun 15 02:03:10.263567 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:10.263491 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d8986dff5-wlpqd" podStartSLOduration=1.380991758 podStartE2EDuration="4.263474926s" totalImagesPullingTime="2.882483168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:03:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:03:10.262034403 +0000 UTC m=+304.845926225" watchObservedRunningTime="2026-06-15 02:03:10.263474926 +0000 UTC m=+304.847366760" Jun 15 02:03:15.751901 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:15.751862 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:15.896829 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:15.896797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:16.030169 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:16.030073 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:16.135751 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:16.135718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:17.085942 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:17.085911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:17.186304 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:17.186272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:17.313549 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:17.313509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:18.947197 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:18.947158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:19.057511 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:19.057479 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:20.024920 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:20.024860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:20.131882 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:20.131838 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:20.858915 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:20.858860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:20.958900 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:20.958859 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:21.531789 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:21.531751 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:22.575761 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:22.575727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:32.022253 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:32.022222 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:32.119773 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:32.119741 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:36.633049 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:36.633020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:36.701495 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:36.701460 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:37.152142 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:37.152111 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:40.843982 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:40.843948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:40.943959 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:40.943926 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:41.128892 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:41.128809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:41.295922 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:41.295891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:41.655446 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:41.655413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:03:46.047727 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:03:46.047638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:01.611862 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:01.611826 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:01.672679 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:01.672642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:01.781119 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:01.781088 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:12.727650 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:12.727599 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:14.881787 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:14.881756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:14.987961 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:14.987920 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:30.799455 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:30.799421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:32.729976 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:32.729938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:32.783992 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:32.783963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:32.870487 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:32.870448 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:32.971583 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:32.971525 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:33.546282 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:33.546251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:33.630682 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:33.630648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:35.011973 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:35.011943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:36.938075 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.938043 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx"] Jun 15 02:04:36.941667 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.941649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:36.944859 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.944834 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mp497\"" Jun 15 02:04:36.944859 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.944844 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 02:04:36.945737 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.945718 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 02:04:36.946372 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.946223 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 02:04:36.961514 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:36.961479 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx"] Jun 15 02:04:37.108613 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.108580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m8wq\" (UniqueName: \"kubernetes.io/projected/a61a402f-8100-48af-8197-5382c4a3e1e0-kube-api-access-5m8wq\") pod \"dns-operator-controller-manager-864dd78c4c-fgsbx\" (UID: \"a61a402f-8100-48af-8197-5382c4a3e1e0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:37.209415 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.209323 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m8wq\" (UniqueName: \"kubernetes.io/projected/a61a402f-8100-48af-8197-5382c4a3e1e0-kube-api-access-5m8wq\") pod \"dns-operator-controller-manager-864dd78c4c-fgsbx\" (UID: \"a61a402f-8100-48af-8197-5382c4a3e1e0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:37.218296 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.218258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m8wq\" (UniqueName: \"kubernetes.io/projected/a61a402f-8100-48af-8197-5382c4a3e1e0-kube-api-access-5m8wq\") pod \"dns-operator-controller-manager-864dd78c4c-fgsbx\" (UID: \"a61a402f-8100-48af-8197-5382c4a3e1e0\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:37.258968 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.258929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:37.406523 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.406499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx"] Jun 15 02:04:37.409202 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:04:37.409170 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda61a402f_8100_48af_8197_5382c4a3e1e0.slice/crio-95b9edf7353754a431e4bf41514d5fcd8336d054c6b1b506f626df2ae92311d2 WatchSource:0}: Error finding container 95b9edf7353754a431e4bf41514d5fcd8336d054c6b1b506f626df2ae92311d2: Status 404 returned error can't find the container with id 95b9edf7353754a431e4bf41514d5fcd8336d054c6b1b506f626df2ae92311d2 Jun 15 02:04:37.411442 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.411420 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:04:37.416396 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.416368 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:37.641609 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:37.641577 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" event={"ID":"a61a402f-8100-48af-8197-5382c4a3e1e0","Type":"ContainerStarted","Data":"95b9edf7353754a431e4bf41514d5fcd8336d054c6b1b506f626df2ae92311d2"} Jun 15 02:04:38.017424 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:38.017345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:38.240173 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:38.240139 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:38.354726 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:38.354657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:40.045567 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:40.045469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:40.658210 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:40.658182 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" event={"ID":"a61a402f-8100-48af-8197-5382c4a3e1e0","Type":"ContainerStarted","Data":"dcfd870fcce4f3a334a3669c9acdd0b0c224fbdb13c3fdaf1681af256ef788c5"} Jun 15 02:04:40.658413 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:40.658302 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:41.415512 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:41.415479 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:41.518376 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:41.518327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:43.346815 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:43.346779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:43.448438 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:43.448405 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:43.542395 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:43.542364 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:45.285605 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.285522 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" podStartSLOduration=6.988841305 podStartE2EDuration="9.285504717s" totalImagesPullingTime="2.296663412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:04:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:04:40.712607466 +0000 UTC m=+395.296499269" watchObservedRunningTime="2026-06-15 02:04:45.285504717 +0000 UTC m=+399.869396519" Jun 15 02:04:45.286010 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.285686 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv"] Jun 15 02:04:45.289072 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.289051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.291544 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.291515 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nxrnb\"" Jun 15 02:04:45.299776 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.299754 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv"] Jun 15 02:04:45.382743 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.382701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdbe0a2f-47c2-4646-9620-9da7f99415d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.382914 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.382855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r96vl\" (UniqueName: \"kubernetes.io/projected/fdbe0a2f-47c2-4646-9620-9da7f99415d3-kube-api-access-r96vl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.483676 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.483640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r96vl\" (UniqueName: \"kubernetes.io/projected/fdbe0a2f-47c2-4646-9620-9da7f99415d3-kube-api-access-r96vl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.483851 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.483695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdbe0a2f-47c2-4646-9620-9da7f99415d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.484049 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.484032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdbe0a2f-47c2-4646-9620-9da7f99415d3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.494970 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.494936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r96vl\" (UniqueName: \"kubernetes.io/projected/fdbe0a2f-47c2-4646-9620-9da7f99415d3-kube-api-access-r96vl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.600067 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.600027 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:45.737352 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:45.737326 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv"] Jun 15 02:04:45.740396 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:04:45.740367 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbe0a2f_47c2_4646_9620_9da7f99415d3.slice/crio-662ead387b405fe25fab8674dc5700c7777eb23116c31250fb050f79b28bcb4a WatchSource:0}: Error finding container 662ead387b405fe25fab8674dc5700c7777eb23116c31250fb050f79b28bcb4a: Status 404 returned error can't find the container with id 662ead387b405fe25fab8674dc5700c7777eb23116c31250fb050f79b28bcb4a Jun 15 02:04:46.428378 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:46.428186 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:46.529720 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:46.529687 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:46.687067 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:46.686976 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" event={"ID":"fdbe0a2f-47c2-4646-9620-9da7f99415d3","Type":"ContainerStarted","Data":"662ead387b405fe25fab8674dc5700c7777eb23116c31250fb050f79b28bcb4a"} Jun 15 02:04:49.816562 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:49.816514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:49.916250 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:49.916217 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:51.664795 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:51.664764 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-fgsbx" Jun 15 02:04:53.723225 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:53.723187 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" event={"ID":"fdbe0a2f-47c2-4646-9620-9da7f99415d3","Type":"ContainerStarted","Data":"c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea"} Jun 15 02:04:53.723740 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:53.723316 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:04:53.742976 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:53.742922 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" podStartSLOduration=1.543361712 podStartE2EDuration="8.742907776s" totalImagesPullingTime="7.199546064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:04:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:04:53.740476692 +0000 UTC m=+408.324368494" watchObservedRunningTime="2026-06-15 02:04:53.742907776 +0000 UTC m=+408.326799578" Jun 15 02:04:55.609784 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:55.609747 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:55.700386 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:55.700356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:55.765798 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:55.765764 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:55.866438 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:55.866343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:55.966734 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:55.966700 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:56.429587 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:56.429555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:58.955191 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:58.955158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:04:59.055153 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:04:59.055117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:04.730491 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:04.730455 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:05.648643 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:05.648611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:05.750645 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:05.750610 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:06.415285 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.415248 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv"] Jun 15 02:05:06.415501 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.415455 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" containerName="manager" containerID="cri-o://c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea" gracePeriod=2 Jun 15 02:05:06.419959 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.419921 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv"] Jun 15 02:05:06.439591 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.439561 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q"] Jun 15 02:05:06.439980 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.439965 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" containerName="manager" Jun 15 02:05:06.439980 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.439980 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" containerName="manager" Jun 15 02:05:06.440117 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.440045 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" containerName="manager" Jun 15 02:05:06.443306 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.443284 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.457152 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.457111 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q"] Jun 15 02:05:06.475510 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:05:06.475462 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:06.575742 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.575703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f915f747-2e59-477a-b308-4f5c4ad74c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jt48q\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.575900 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.575805 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgmm2\" (UniqueName: \"kubernetes.io/projected/f915f747-2e59-477a-b308-4f5c4ad74c88-kube-api-access-tgmm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jt48q\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.663433 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.663406 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:06.665730 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:05:06.665675 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:06.677121 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.677089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f915f747-2e59-477a-b308-4f5c4ad74c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jt48q\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.677209 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.677147 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgmm2\" (UniqueName: \"kubernetes.io/projected/f915f747-2e59-477a-b308-4f5c4ad74c88-kube-api-access-tgmm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jt48q\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.677476 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.677458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f915f747-2e59-477a-b308-4f5c4ad74c88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jt48q\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.685632 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.685598 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgmm2\" (UniqueName: \"kubernetes.io/projected/f915f747-2e59-477a-b308-4f5c4ad74c88-kube-api-access-tgmm2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jt48q\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.777623 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.777584 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdbe0a2f-47c2-4646-9620-9da7f99415d3-extensions-socket-volume\") pod \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " Jun 15 02:05:06.778065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.777649 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r96vl\" (UniqueName: \"kubernetes.io/projected/fdbe0a2f-47c2-4646-9620-9da7f99415d3-kube-api-access-r96vl\") pod \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\" (UID: \"fdbe0a2f-47c2-4646-9620-9da7f99415d3\") " Jun 15 02:05:06.778065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.777981 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fdbe0a2f-47c2-4646-9620-9da7f99415d3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fdbe0a2f-47c2-4646-9620-9da7f99415d3" (UID: "fdbe0a2f-47c2-4646-9620-9da7f99415d3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:05:06.779866 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.779832 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbe0a2f-47c2-4646-9620-9da7f99415d3-kube-api-access-r96vl" (OuterVolumeSpecName: "kube-api-access-r96vl") pod "fdbe0a2f-47c2-4646-9620-9da7f99415d3" (UID: "fdbe0a2f-47c2-4646-9620-9da7f99415d3"). InnerVolumeSpecName "kube-api-access-r96vl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:05:06.783099 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.783070 2562 generic.go:356] "Generic (PLEG): container finished" podID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" containerID="c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea" exitCode=0 Jun 15 02:05:06.783201 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.783112 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:06.783201 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.783138 2562 scope.go:117] "RemoveContainer" containerID="c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea" Jun 15 02:05:06.783804 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.783781 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:06.787255 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:05:06.787225 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:06.793137 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:05:06.793111 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xmcfv\" is forbidden: User \"system:node:ip-10-0-139-93.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-93.ec2.internal' and this object" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xmcfv" Jun 15 02:05:06.795574 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.795555 2562 scope.go:117] "RemoveContainer" containerID="c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea" Jun 15 02:05:06.795870 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:05:06.795851 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea\": container with ID starting with c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea not found: ID does not exist" containerID="c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea" Jun 15 02:05:06.795930 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.795880 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea"} err="failed to get container status \"c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea\": rpc error: code = NotFound desc = could not find container \"c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea\": container with ID starting with c46f6d4689c6eeef0890effa6e0a7ae151ffdea8dc7f3de2dbce7064fef122ea not found: ID does not exist" Jun 15 02:05:06.879200 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.879164 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r96vl\" (UniqueName: \"kubernetes.io/projected/fdbe0a2f-47c2-4646-9620-9da7f99415d3-kube-api-access-r96vl\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:05:06.879200 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.879195 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdbe0a2f-47c2-4646-9620-9da7f99415d3-extensions-socket-volume\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:05:06.924243 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:06.924211 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q"] Jun 15 02:05:06.926992 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:05:06.926954 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf915f747_2e59_477a_b308_4f5c4ad74c88.slice/crio-72c8abefea088a2611caaf3396497e6c494371c0e8d50bf0d5296af3967357e1 WatchSource:0}: Error finding container 72c8abefea088a2611caaf3396497e6c494371c0e8d50bf0d5296af3967357e1: Status 404 returned error can't find the container with id 72c8abefea088a2611caaf3396497e6c494371c0e8d50bf0d5296af3967357e1 Jun 15 02:05:07.793200 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:07.793165 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdbe0a2f-47c2-4646-9620-9da7f99415d3" path="/var/lib/kubelet/pods/fdbe0a2f-47c2-4646-9620-9da7f99415d3/volumes" Jun 15 02:05:07.794748 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:07.794714 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" event={"ID":"f915f747-2e59-477a-b308-4f5c4ad74c88","Type":"ContainerStarted","Data":"3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495"} Jun 15 02:05:07.794897 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:07.794829 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:07.794897 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:07.794869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" event={"ID":"f915f747-2e59-477a-b308-4f5c4ad74c88","Type":"ContainerStarted","Data":"72c8abefea088a2611caaf3396497e6c494371c0e8d50bf0d5296af3967357e1"} Jun 15 02:05:07.814947 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:07.814900 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" podStartSLOduration=1.814885434 podStartE2EDuration="1.814885434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:05:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:05:07.812764371 +0000 UTC m=+422.396656196" watchObservedRunningTime="2026-06-15 02:05:07.814885434 +0000 UTC m=+422.398777237" Jun 15 02:05:08.648680 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:08.648641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:08.742719 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:08.742686 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:13.440727 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:13.440645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:13.540983 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:13.540949 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:13.645949 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:13.645912 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:13.705023 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:13.704947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:18.640198 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:18.640157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:18.698099 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:18.698059 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:18.803024 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:18.802997 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:33.384552 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:33.384503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:33.438518 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:33.438461 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:37.404915 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.404877 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q"] Jun 15 02:05:37.405406 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.405159 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" podUID="f915f747-2e59-477a-b308-4f5c4ad74c88" containerName="manager" containerID="cri-o://3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495" gracePeriod=10 Jun 15 02:05:37.637335 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.637300 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26"] Jun 15 02:05:37.640904 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.640884 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.652679 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.652643 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7dw\" (UniqueName: \"kubernetes.io/projected/bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc-kube-api-access-mg7dw\") pod \"kuadrant-operator-controller-manager-86878c769f-hqz26\" (UID: \"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.652810 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.652712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hqz26\" (UID: \"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.653153 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.653133 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26"] Jun 15 02:05:37.661330 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.661276 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:37.753494 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.753453 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgmm2\" (UniqueName: \"kubernetes.io/projected/f915f747-2e59-477a-b308-4f5c4ad74c88-kube-api-access-tgmm2\") pod \"f915f747-2e59-477a-b308-4f5c4ad74c88\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " Jun 15 02:05:37.753700 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.753514 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f915f747-2e59-477a-b308-4f5c4ad74c88-extensions-socket-volume\") pod \"f915f747-2e59-477a-b308-4f5c4ad74c88\" (UID: \"f915f747-2e59-477a-b308-4f5c4ad74c88\") " Jun 15 02:05:37.753700 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.753673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hqz26\" (UID: \"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.753811 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.753794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7dw\" (UniqueName: \"kubernetes.io/projected/bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc-kube-api-access-mg7dw\") pod \"kuadrant-operator-controller-manager-86878c769f-hqz26\" (UID: \"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.753936 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.753905 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f915f747-2e59-477a-b308-4f5c4ad74c88-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f915f747-2e59-477a-b308-4f5c4ad74c88" (UID: "f915f747-2e59-477a-b308-4f5c4ad74c88"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 02:05:37.754097 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.754076 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hqz26\" (UID: \"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.755672 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.755650 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f915f747-2e59-477a-b308-4f5c4ad74c88-kube-api-access-tgmm2" (OuterVolumeSpecName: "kube-api-access-tgmm2") pod "f915f747-2e59-477a-b308-4f5c4ad74c88" (UID: "f915f747-2e59-477a-b308-4f5c4ad74c88"). InnerVolumeSpecName "kube-api-access-tgmm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:05:37.761741 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.761719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7dw\" (UniqueName: \"kubernetes.io/projected/bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc-kube-api-access-mg7dw\") pod \"kuadrant-operator-controller-manager-86878c769f-hqz26\" (UID: \"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.854883 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.854843 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgmm2\" (UniqueName: \"kubernetes.io/projected/f915f747-2e59-477a-b308-4f5c4ad74c88-kube-api-access-tgmm2\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:05:37.854883 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.854875 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f915f747-2e59-477a-b308-4f5c4ad74c88-extensions-socket-volume\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:05:37.946061 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.945971 2562 generic.go:356] "Generic (PLEG): container finished" podID="f915f747-2e59-477a-b308-4f5c4ad74c88" containerID="3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495" exitCode=0 Jun 15 02:05:37.946061 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.946017 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" Jun 15 02:05:37.946264 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.946058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" event={"ID":"f915f747-2e59-477a-b308-4f5c4ad74c88","Type":"ContainerDied","Data":"3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495"} Jun 15 02:05:37.946264 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.946111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q" event={"ID":"f915f747-2e59-477a-b308-4f5c4ad74c88","Type":"ContainerDied","Data":"72c8abefea088a2611caaf3396497e6c494371c0e8d50bf0d5296af3967357e1"} Jun 15 02:05:37.946264 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.946132 2562 scope.go:117] "RemoveContainer" containerID="3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495" Jun 15 02:05:37.954838 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.954816 2562 scope.go:117] "RemoveContainer" containerID="3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495" Jun 15 02:05:37.955158 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:05:37.955139 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495\": container with ID starting with 3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495 not found: ID does not exist" containerID="3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495" Jun 15 02:05:37.955223 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.955183 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495"} err="failed to get container status \"3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495\": rpc error: code = NotFound desc = could not find container \"3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495\": container with ID starting with 3fd7bc696165cdfc55d7d56cf8b0e7d37765436f5ef869a1c89aa4eb3e818495 not found: ID does not exist" Jun 15 02:05:37.962423 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.962393 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q"] Jun 15 02:05:37.968434 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.968407 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:37.971251 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:37.971220 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jt48q"] Jun 15 02:05:38.105048 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:38.105012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26"] Jun 15 02:05:38.108206 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:05:38.108180 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9a01fb_3d1c_49f7_91db_4eec6c9e17fc.slice/crio-b59797a041b5afaae200b6ccc943a36e1b438a4f3c03fda4df01b312c0c3507c WatchSource:0}: Error finding container b59797a041b5afaae200b6ccc943a36e1b438a4f3c03fda4df01b312c0c3507c: Status 404 returned error can't find the container with id b59797a041b5afaae200b6ccc943a36e1b438a4f3c03fda4df01b312c0c3507c Jun 15 02:05:38.953976 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:38.953941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" event={"ID":"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc","Type":"ContainerStarted","Data":"10c061beae6cb3a4c48955cf88e93680c58e2405fae94c4e1379a4362ceae3e7"} Jun 15 02:05:38.954394 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:38.953998 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" event={"ID":"bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc","Type":"ContainerStarted","Data":"b59797a041b5afaae200b6ccc943a36e1b438a4f3c03fda4df01b312c0c3507c"} Jun 15 02:05:38.954394 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:38.954037 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:38.980610 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:38.980559 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" podStartSLOduration=1.9805419309999999 podStartE2EDuration="1.980541931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:05:38.97861276 +0000 UTC m=+453.562504571" watchObservedRunningTime="2026-06-15 02:05:38.980541931 +0000 UTC m=+453.564433724" Jun 15 02:05:39.788031 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:39.787992 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f915f747-2e59-477a-b308-4f5c4ad74c88" path="/var/lib/kubelet/pods/f915f747-2e59-477a-b308-4f5c4ad74c88/volumes" Jun 15 02:05:41.545793 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:41.545744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:49.961103 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:49.961064 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hqz26" Jun 15 02:05:53.730198 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:53.730152 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:53.967991 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:53.967931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:57.898510 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:57.898470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:58.011157 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.011116 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:58.063213 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.063182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:58.690093 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.690059 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-fn8c9"] Jun 15 02:05:58.690448 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.690434 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f915f747-2e59-477a-b308-4f5c4ad74c88" containerName="manager" Jun 15 02:05:58.690508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.690449 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f915f747-2e59-477a-b308-4f5c4ad74c88" containerName="manager" Jun 15 02:05:58.690571 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.690511 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f915f747-2e59-477a-b308-4f5c4ad74c88" containerName="manager" Jun 15 02:05:58.693614 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.693596 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:05:58.695852 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.695830 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hpprf\"" Jun 15 02:05:58.700328 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.700303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fn8c9"] Jun 15 02:05:58.718061 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.718010 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:58.774511 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.774477 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:05:58.795573 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.795524 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgbgg"] Jun 15 02:05:58.799045 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.799023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:05:58.806734 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.806709 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgbgg"] Jun 15 02:05:58.846243 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.846202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhflm\" (UniqueName: \"kubernetes.io/projected/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1-kube-api-access-qhflm\") pod \"authorino-58cd955675-fn8c9\" (UID: \"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1\") " pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:05:58.947588 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.947462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xhtd\" (UniqueName: \"kubernetes.io/projected/4991d4e3-973e-449a-89fd-d6c06dea0304-kube-api-access-9xhtd\") pod \"authorino-75d556bd77-rgbgg\" (UID: \"4991d4e3-973e-449a-89fd-d6c06dea0304\") " pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:05:58.947588 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.947559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhflm\" (UniqueName: \"kubernetes.io/projected/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1-kube-api-access-qhflm\") pod \"authorino-58cd955675-fn8c9\" (UID: \"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1\") " pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:05:58.955683 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:58.955655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhflm\" (UniqueName: \"kubernetes.io/projected/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1-kube-api-access-qhflm\") pod \"authorino-58cd955675-fn8c9\" (UID: \"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1\") " pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:05:59.004961 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:59.004923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:05:59.048991 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:59.048954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xhtd\" (UniqueName: \"kubernetes.io/projected/4991d4e3-973e-449a-89fd-d6c06dea0304-kube-api-access-9xhtd\") pod \"authorino-75d556bd77-rgbgg\" (UID: \"4991d4e3-973e-449a-89fd-d6c06dea0304\") " pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:05:59.057744 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:59.057695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xhtd\" (UniqueName: \"kubernetes.io/projected/4991d4e3-973e-449a-89fd-d6c06dea0304-kube-api-access-9xhtd\") pod \"authorino-75d556bd77-rgbgg\" (UID: \"4991d4e3-973e-449a-89fd-d6c06dea0304\") " pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:05:59.109426 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:59.109139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:05:59.138557 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:59.138404 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-fn8c9"] Jun 15 02:05:59.141335 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:05:59.141303 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c04dfe6_17ff_42fe_8b5a_c8953ade27f1.slice/crio-f714cd81d6690d8edb84b444441ac46b1a63b3ffbfe1a217a5dd6f7de0a08e57 WatchSource:0}: Error finding container f714cd81d6690d8edb84b444441ac46b1a63b3ffbfe1a217a5dd6f7de0a08e57: Status 404 returned error can't find the container with id f714cd81d6690d8edb84b444441ac46b1a63b3ffbfe1a217a5dd6f7de0a08e57 Jun 15 02:05:59.243122 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:05:59.243098 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgbgg"] Jun 15 02:05:59.245424 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:05:59.245398 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4991d4e3_973e_449a_89fd_d6c06dea0304.slice/crio-afcd4cb990101763f29f64d6de7c92f88b8bf0509604c4650c330f915b3ebe3a WatchSource:0}: Error finding container afcd4cb990101763f29f64d6de7c92f88b8bf0509604c4650c330f915b3ebe3a: Status 404 returned error can't find the container with id afcd4cb990101763f29f64d6de7c92f88b8bf0509604c4650c330f915b3ebe3a Jun 15 02:06:00.056618 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:00.056510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgbgg" event={"ID":"4991d4e3-973e-449a-89fd-d6c06dea0304","Type":"ContainerStarted","Data":"afcd4cb990101763f29f64d6de7c92f88b8bf0509604c4650c330f915b3ebe3a"} Jun 15 02:06:00.059477 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:00.059404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fn8c9" event={"ID":"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1","Type":"ContainerStarted","Data":"f714cd81d6690d8edb84b444441ac46b1a63b3ffbfe1a217a5dd6f7de0a08e57"} Jun 15 02:06:03.079412 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:03.079371 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgbgg" event={"ID":"4991d4e3-973e-449a-89fd-d6c06dea0304","Type":"ContainerStarted","Data":"8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e"} Jun 15 02:06:03.080891 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:03.080867 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fn8c9" event={"ID":"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1","Type":"ContainerStarted","Data":"a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de"} Jun 15 02:06:03.094157 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:03.094108 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rgbgg" podStartSLOduration=1.5861290829999999 podStartE2EDuration="5.09409268s" totalImagesPullingTime="3.507963597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:06:03.092453618 +0000 UTC m=+477.676345421" watchObservedRunningTime="2026-06-15 02:06:03.09409268 +0000 UTC m=+477.677984481" Jun 15 02:06:03.105595 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:03.105526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-fn8c9" podStartSLOduration=1.508121999 podStartE2EDuration="5.105507783s" totalImagesPullingTime="3.597385784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:05:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:06:03.104667598 +0000 UTC m=+477.688559401" watchObservedRunningTime="2026-06-15 02:06:03.105507783 +0000 UTC m=+477.689399584" Jun 15 02:06:03.126981 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:03.126939 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fn8c9"] Jun 15 02:06:05.090063 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:05.090021 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-fn8c9" podUID="6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" containerName="authorino" containerID="cri-o://a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de" gracePeriod=30 Jun 15 02:06:05.342870 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:05.342809 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:06:05.509097 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:05.509056 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhflm\" (UniqueName: \"kubernetes.io/projected/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1-kube-api-access-qhflm\") pod \"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1\" (UID: \"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1\") " Jun 15 02:06:05.511122 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:05.511093 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1-kube-api-access-qhflm" (OuterVolumeSpecName: "kube-api-access-qhflm") pod "6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" (UID: "6c04dfe6-17ff-42fe-8b5a-c8953ade27f1"). InnerVolumeSpecName "kube-api-access-qhflm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:06:05.610675 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:05.610592 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhflm\" (UniqueName: \"kubernetes.io/projected/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1-kube-api-access-qhflm\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:06:06.096034 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.095996 2562 generic.go:356] "Generic (PLEG): container finished" podID="6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" containerID="a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de" exitCode=0 Jun 15 02:06:06.096508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.096046 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-fn8c9" Jun 15 02:06:06.096508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.096085 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fn8c9" event={"ID":"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1","Type":"ContainerDied","Data":"a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de"} Jun 15 02:06:06.096508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.096128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-fn8c9" event={"ID":"6c04dfe6-17ff-42fe-8b5a-c8953ade27f1","Type":"ContainerDied","Data":"f714cd81d6690d8edb84b444441ac46b1a63b3ffbfe1a217a5dd6f7de0a08e57"} Jun 15 02:06:06.096508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.096146 2562 scope.go:117] "RemoveContainer" containerID="a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de" Jun 15 02:06:06.104879 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.104859 2562 scope.go:117] "RemoveContainer" containerID="a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de" Jun 15 02:06:06.105140 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:06:06.105119 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de\": container with ID starting with a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de not found: ID does not exist" containerID="a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de" Jun 15 02:06:06.105213 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.105152 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de"} err="failed to get container status \"a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de\": rpc error: code = NotFound desc = could not find container \"a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de\": container with ID starting with a6f4e958715d1ce4c83a0c9c24fa7981711a700dcfa6a4b836202bf224c4c2de not found: ID does not exist" Jun 15 02:06:06.111174 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.111148 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-fn8c9"] Jun 15 02:06:06.116023 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:06.116001 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-fn8c9"] Jun 15 02:06:07.787326 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:07.787293 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" path="/var/lib/kubelet/pods/6c04dfe6-17ff-42fe-8b5a-c8953ade27f1/volumes" Jun 15 02:06:17.025952 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:17.025918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:26.234994 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:26.234955 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:26.325086 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:26.325052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:26.455964 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:26.455931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:36.895861 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.895826 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-wqz7d"] Jun 15 02:06:36.896235 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.896186 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" containerName="authorino" Jun 15 02:06:36.896235 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.896198 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" containerName="authorino" Jun 15 02:06:36.896306 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.896262 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c04dfe6-17ff-42fe-8b5a-c8953ade27f1" containerName="authorino" Jun 15 02:06:36.899437 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.899421 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" Jun 15 02:06:36.901920 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.901900 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 02:06:36.902751 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.902735 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 02:06:36.902840 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.902736 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-2gj6l\"" Jun 15 02:06:36.908786 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.908764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-wqz7d"] Jun 15 02:06:36.970495 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:36.970452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkrqf\" (UniqueName: \"kubernetes.io/projected/a7bede98-4753-4c3e-a16f-527fca7ee5c4-kube-api-access-nkrqf\") pod \"keycloak-operator-d67dbbb48-wqz7d\" (UID: \"a7bede98-4753-4c3e-a16f-527fca7ee5c4\") " pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" Jun 15 02:06:37.071108 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:37.071062 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkrqf\" (UniqueName: \"kubernetes.io/projected/a7bede98-4753-4c3e-a16f-527fca7ee5c4-kube-api-access-nkrqf\") pod \"keycloak-operator-d67dbbb48-wqz7d\" (UID: \"a7bede98-4753-4c3e-a16f-527fca7ee5c4\") " pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" Jun 15 02:06:37.082466 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:37.082395 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkrqf\" (UniqueName: \"kubernetes.io/projected/a7bede98-4753-4c3e-a16f-527fca7ee5c4-kube-api-access-nkrqf\") pod \"keycloak-operator-d67dbbb48-wqz7d\" (UID: \"a7bede98-4753-4c3e-a16f-527fca7ee5c4\") " pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" Jun 15 02:06:37.211346 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:37.211254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" Jun 15 02:06:37.352139 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:37.352065 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-wqz7d"] Jun 15 02:06:37.355111 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:06:37.355081 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7bede98_4753_4c3e_a16f_527fca7ee5c4.slice/crio-b2e633b6bcce58a042330eab98abce13e87aea97495455ddd1ea1753d0553c1c WatchSource:0}: Error finding container b2e633b6bcce58a042330eab98abce13e87aea97495455ddd1ea1753d0553c1c: Status 404 returned error can't find the container with id b2e633b6bcce58a042330eab98abce13e87aea97495455ddd1ea1753d0553c1c Jun 15 02:06:38.248577 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:38.248478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" event={"ID":"a7bede98-4753-4c3e-a16f-527fca7ee5c4","Type":"ContainerStarted","Data":"b2e633b6bcce58a042330eab98abce13e87aea97495455ddd1ea1753d0553c1c"} Jun 15 02:06:44.285011 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:44.284923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" event={"ID":"a7bede98-4753-4c3e-a16f-527fca7ee5c4","Type":"ContainerStarted","Data":"01bff56a71f2a8376ef247fa04b44fc879fb56d4c3845f626dcc7b0e716b448b"} Jun 15 02:06:44.303562 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:44.303492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-wqz7d" podStartSLOduration=1.743181695 podStartE2EDuration="8.30347782s" totalImagesPullingTime="6.560296125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:06:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:06:44.301110953 +0000 UTC m=+518.885002767" watchObservedRunningTime="2026-06-15 02:06:44.30347782 +0000 UTC m=+518.887369622" Jun 15 02:06:53.303309 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:53.303273 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:53.403939 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:53.403897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:55.041405 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:55.041367 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:06:55.090738 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:06:55.090706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:22.919836 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:22.919797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:23.147712 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.147675 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q9vm9"] Jun 15 02:07:23.149948 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.149922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:23.158445 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.158409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:23.159034 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.159007 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q9vm9"] Jun 15 02:07:23.200334 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.200228 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lttnm\" (UniqueName: \"kubernetes.io/projected/87f8838d-434b-446f-8aa2-e07cb3e74edc-kube-api-access-lttnm\") pod \"authorino-5d4b67c446-q9vm9\" (UID: \"87f8838d-434b-446f-8aa2-e07cb3e74edc\") " pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:23.301008 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.300971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lttnm\" (UniqueName: \"kubernetes.io/projected/87f8838d-434b-446f-8aa2-e07cb3e74edc-kube-api-access-lttnm\") pod \"authorino-5d4b67c446-q9vm9\" (UID: \"87f8838d-434b-446f-8aa2-e07cb3e74edc\") " pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:23.308706 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.308673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lttnm\" (UniqueName: \"kubernetes.io/projected/87f8838d-434b-446f-8aa2-e07cb3e74edc-kube-api-access-lttnm\") pod \"authorino-5d4b67c446-q9vm9\" (UID: \"87f8838d-434b-446f-8aa2-e07cb3e74edc\") " pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:23.367775 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.367740 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q9vm9"] Jun 15 02:07:23.368095 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.368082 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:23.390036 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.389998 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d54d4c4ff-vzjrz"] Jun 15 02:07:23.392398 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.392380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:23.399947 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.399918 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d54d4c4ff-vzjrz"] Jun 15 02:07:23.503192 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.503111 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69pt6\" (UniqueName: \"kubernetes.io/projected/4b9c1e49-e7ae-45ca-a863-6377247a8aee-kube-api-access-69pt6\") pod \"authorino-7d54d4c4ff-vzjrz\" (UID: \"4b9c1e49-e7ae-45ca-a863-6377247a8aee\") " pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:23.504940 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.504920 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q9vm9"] Jun 15 02:07:23.507255 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:07:23.507219 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87f8838d_434b_446f_8aa2_e07cb3e74edc.slice/crio-3b0984396ed7c5acae0e0cc28a61b883af5d657194a267b3b41241f0d14b7104 WatchSource:0}: Error finding container 3b0984396ed7c5acae0e0cc28a61b883af5d657194a267b3b41241f0d14b7104: Status 404 returned error can't find the container with id 3b0984396ed7c5acae0e0cc28a61b883af5d657194a267b3b41241f0d14b7104 Jun 15 02:07:23.604613 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.604576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69pt6\" (UniqueName: \"kubernetes.io/projected/4b9c1e49-e7ae-45ca-a863-6377247a8aee-kube-api-access-69pt6\") pod \"authorino-7d54d4c4ff-vzjrz\" (UID: \"4b9c1e49-e7ae-45ca-a863-6377247a8aee\") " pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:23.612391 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.612353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69pt6\" (UniqueName: \"kubernetes.io/projected/4b9c1e49-e7ae-45ca-a863-6377247a8aee-kube-api-access-69pt6\") pod \"authorino-7d54d4c4ff-vzjrz\" (UID: \"4b9c1e49-e7ae-45ca-a863-6377247a8aee\") " pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:23.656743 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.656700 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d54d4c4ff-vzjrz"] Jun 15 02:07:23.657058 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.657039 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:23.686915 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.686878 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ff497f46c-jmr98"] Jun 15 02:07:23.690041 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.690018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:23.692322 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.692303 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 02:07:23.697874 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.697849 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff497f46c-jmr98"] Jun 15 02:07:23.794622 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.794599 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d54d4c4ff-vzjrz"] Jun 15 02:07:23.796975 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:07:23.796946 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b9c1e49_e7ae_45ca_a863_6377247a8aee.slice/crio-691d9021f248c74f708da0212681640430e20ea6d8021aae448c1989069fab0a WatchSource:0}: Error finding container 691d9021f248c74f708da0212681640430e20ea6d8021aae448c1989069fab0a: Status 404 returned error can't find the container with id 691d9021f248c74f708da0212681640430e20ea6d8021aae448c1989069fab0a Jun 15 02:07:23.806337 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.806312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b590ab-490f-4cfc-bc2d-73a019b523c8-tls-cert\") pod \"authorino-7ff497f46c-jmr98\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:23.806460 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.806366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sz8g\" (UniqueName: \"kubernetes.io/projected/b8b590ab-490f-4cfc-bc2d-73a019b523c8-kube-api-access-5sz8g\") pod \"authorino-7ff497f46c-jmr98\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:23.907887 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.907831 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sz8g\" (UniqueName: \"kubernetes.io/projected/b8b590ab-490f-4cfc-bc2d-73a019b523c8-kube-api-access-5sz8g\") pod \"authorino-7ff497f46c-jmr98\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:23.908091 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.907995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b590ab-490f-4cfc-bc2d-73a019b523c8-tls-cert\") pod \"authorino-7ff497f46c-jmr98\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:23.910694 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.910669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b590ab-490f-4cfc-bc2d-73a019b523c8-tls-cert\") pod \"authorino-7ff497f46c-jmr98\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:23.915953 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:23.915920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sz8g\" (UniqueName: \"kubernetes.io/projected/b8b590ab-490f-4cfc-bc2d-73a019b523c8-kube-api-access-5sz8g\") pod \"authorino-7ff497f46c-jmr98\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:24.003678 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.003556 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:07:24.140754 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.140728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ff497f46c-jmr98"] Jun 15 02:07:24.144064 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:07:24.144035 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8b590ab_490f_4cfc_bc2d_73a019b523c8.slice/crio-b41ad4bbd22b64b783b0edc3adb7159d7d41286bbf3c6151cdfab75e703049e5 WatchSource:0}: Error finding container b41ad4bbd22b64b783b0edc3adb7159d7d41286bbf3c6151cdfab75e703049e5: Status 404 returned error can't find the container with id b41ad4bbd22b64b783b0edc3adb7159d7d41286bbf3c6151cdfab75e703049e5 Jun 15 02:07:24.487591 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.487552 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" event={"ID":"4b9c1e49-e7ae-45ca-a863-6377247a8aee","Type":"ContainerStarted","Data":"bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e"} Jun 15 02:07:24.487919 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.487605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" event={"ID":"4b9c1e49-e7ae-45ca-a863-6377247a8aee","Type":"ContainerStarted","Data":"691d9021f248c74f708da0212681640430e20ea6d8021aae448c1989069fab0a"} Jun 15 02:07:24.487919 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.487614 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" podUID="4b9c1e49-e7ae-45ca-a863-6377247a8aee" containerName="authorino" containerID="cri-o://bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e" gracePeriod=30 Jun 15 02:07:24.489206 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.489181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" event={"ID":"87f8838d-434b-446f-8aa2-e07cb3e74edc","Type":"ContainerStarted","Data":"1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f"} Jun 15 02:07:24.489328 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.489198 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" podUID="87f8838d-434b-446f-8aa2-e07cb3e74edc" containerName="authorino" containerID="cri-o://1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f" gracePeriod=30 Jun 15 02:07:24.489328 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.489218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" event={"ID":"87f8838d-434b-446f-8aa2-e07cb3e74edc","Type":"ContainerStarted","Data":"3b0984396ed7c5acae0e0cc28a61b883af5d657194a267b3b41241f0d14b7104"} Jun 15 02:07:24.490874 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.490652 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff497f46c-jmr98" event={"ID":"b8b590ab-490f-4cfc-bc2d-73a019b523c8","Type":"ContainerStarted","Data":"b41ad4bbd22b64b783b0edc3adb7159d7d41286bbf3c6151cdfab75e703049e5"} Jun 15 02:07:24.504783 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.504721 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" podStartSLOduration=1.228630704 podStartE2EDuration="1.504699653s" totalImagesPullingTime="276.068949ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:07:24.502010697 +0000 UTC m=+559.085902522" watchObservedRunningTime="2026-06-15 02:07:24.504699653 +0000 UTC m=+559.088591455" Jun 15 02:07:24.517505 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.517453 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" podStartSLOduration=1.1958011769999999 podStartE2EDuration="1.517434811s" totalImagesPullingTime="321.633634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:07:24.516386439 +0000 UTC m=+559.100278242" watchObservedRunningTime="2026-06-15 02:07:24.517434811 +0000 UTC m=+559.101326603" Jun 15 02:07:24.759853 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.759827 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:24.769963 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.769932 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:24.817945 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.817909 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69pt6\" (UniqueName: \"kubernetes.io/projected/4b9c1e49-e7ae-45ca-a863-6377247a8aee-kube-api-access-69pt6\") pod \"4b9c1e49-e7ae-45ca-a863-6377247a8aee\" (UID: \"4b9c1e49-e7ae-45ca-a863-6377247a8aee\") " Jun 15 02:07:24.818118 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.817990 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lttnm\" (UniqueName: \"kubernetes.io/projected/87f8838d-434b-446f-8aa2-e07cb3e74edc-kube-api-access-lttnm\") pod \"87f8838d-434b-446f-8aa2-e07cb3e74edc\" (UID: \"87f8838d-434b-446f-8aa2-e07cb3e74edc\") " Jun 15 02:07:24.819957 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.819926 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b9c1e49-e7ae-45ca-a863-6377247a8aee-kube-api-access-69pt6" (OuterVolumeSpecName: "kube-api-access-69pt6") pod "4b9c1e49-e7ae-45ca-a863-6377247a8aee" (UID: "4b9c1e49-e7ae-45ca-a863-6377247a8aee"). InnerVolumeSpecName "kube-api-access-69pt6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:07:24.820075 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.819958 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f8838d-434b-446f-8aa2-e07cb3e74edc-kube-api-access-lttnm" (OuterVolumeSpecName: "kube-api-access-lttnm") pod "87f8838d-434b-446f-8aa2-e07cb3e74edc" (UID: "87f8838d-434b-446f-8aa2-e07cb3e74edc"). InnerVolumeSpecName "kube-api-access-lttnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:07:24.919326 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.919288 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69pt6\" (UniqueName: \"kubernetes.io/projected/4b9c1e49-e7ae-45ca-a863-6377247a8aee-kube-api-access-69pt6\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:07:24.919326 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:24.919320 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lttnm\" (UniqueName: \"kubernetes.io/projected/87f8838d-434b-446f-8aa2-e07cb3e74edc-kube-api-access-lttnm\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:07:25.497508 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.497467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff497f46c-jmr98" event={"ID":"b8b590ab-490f-4cfc-bc2d-73a019b523c8","Type":"ContainerStarted","Data":"a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d"} Jun 15 02:07:25.498685 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.498658 2562 generic.go:356] "Generic (PLEG): container finished" podID="4b9c1e49-e7ae-45ca-a863-6377247a8aee" containerID="bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e" exitCode=0 Jun 15 02:07:25.498807 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.498690 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" Jun 15 02:07:25.498807 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.498734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" event={"ID":"4b9c1e49-e7ae-45ca-a863-6377247a8aee","Type":"ContainerDied","Data":"bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e"} Jun 15 02:07:25.498807 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.498768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d54d4c4ff-vzjrz" event={"ID":"4b9c1e49-e7ae-45ca-a863-6377247a8aee","Type":"ContainerDied","Data":"691d9021f248c74f708da0212681640430e20ea6d8021aae448c1989069fab0a"} Jun 15 02:07:25.498807 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.498787 2562 scope.go:117] "RemoveContainer" containerID="bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e" Jun 15 02:07:25.500000 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.499978 2562 generic.go:356] "Generic (PLEG): container finished" podID="87f8838d-434b-446f-8aa2-e07cb3e74edc" containerID="1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f" exitCode=0 Jun 15 02:07:25.500140 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.500017 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" Jun 15 02:07:25.500140 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.500029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" event={"ID":"87f8838d-434b-446f-8aa2-e07cb3e74edc","Type":"ContainerDied","Data":"1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f"} Jun 15 02:07:25.500140 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.500050 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q9vm9" event={"ID":"87f8838d-434b-446f-8aa2-e07cb3e74edc","Type":"ContainerDied","Data":"3b0984396ed7c5acae0e0cc28a61b883af5d657194a267b3b41241f0d14b7104"} Jun 15 02:07:25.507925 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.507910 2562 scope.go:117] "RemoveContainer" containerID="bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e" Jun 15 02:07:25.508217 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:07:25.508194 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e\": container with ID starting with bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e not found: ID does not exist" containerID="bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e" Jun 15 02:07:25.508334 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.508226 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e"} err="failed to get container status \"bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e\": rpc error: code = NotFound desc = could not find container \"bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e\": container with ID starting with bf710175962f7b0ca54726fddcdfff7c0a00c3547d8d88aea4b0c7a6520e304e not found: ID does not exist" Jun 15 02:07:25.508334 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.508249 2562 scope.go:117] "RemoveContainer" containerID="1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f" Jun 15 02:07:25.513113 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.513075 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ff497f46c-jmr98" podStartSLOduration=2.063729949 podStartE2EDuration="2.513060597s" totalImagesPullingTime="449.330648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:07:25.511854575 +0000 UTC m=+560.095746398" watchObservedRunningTime="2026-06-15 02:07:25.513060597 +0000 UTC m=+560.096952398" Jun 15 02:07:25.516637 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.516616 2562 scope.go:117] "RemoveContainer" containerID="1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f" Jun 15 02:07:25.516906 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:07:25.516887 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f\": container with ID starting with 1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f not found: ID does not exist" containerID="1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f" Jun 15 02:07:25.516964 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.516913 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f"} err="failed to get container status \"1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f\": rpc error: code = NotFound desc = could not find container \"1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f\": container with ID starting with 1d2beedb861d8bcb6c503b06bc9bf0daf5dda91a43b868d1d8f3e31da705681f not found: ID does not exist" Jun 15 02:07:25.532924 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.532890 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q9vm9"] Jun 15 02:07:25.537881 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.537854 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q9vm9"] Jun 15 02:07:25.543313 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.543286 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgbgg"] Jun 15 02:07:25.543498 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.543475 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rgbgg" podUID="4991d4e3-973e-449a-89fd-d6c06dea0304" containerName="authorino" containerID="cri-o://8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e" gracePeriod=30 Jun 15 02:07:25.555440 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.555411 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d54d4c4ff-vzjrz"] Jun 15 02:07:25.565031 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.564964 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d54d4c4ff-vzjrz"] Jun 15 02:07:25.788152 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.788122 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b9c1e49-e7ae-45ca-a863-6377247a8aee" path="/var/lib/kubelet/pods/4b9c1e49-e7ae-45ca-a863-6377247a8aee/volumes" Jun 15 02:07:25.788458 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.788445 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f8838d-434b-446f-8aa2-e07cb3e74edc" path="/var/lib/kubelet/pods/87f8838d-434b-446f-8aa2-e07cb3e74edc/volumes" Jun 15 02:07:25.797683 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.797658 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:07:25.927518 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.927488 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xhtd\" (UniqueName: \"kubernetes.io/projected/4991d4e3-973e-449a-89fd-d6c06dea0304-kube-api-access-9xhtd\") pod \"4991d4e3-973e-449a-89fd-d6c06dea0304\" (UID: \"4991d4e3-973e-449a-89fd-d6c06dea0304\") " Jun 15 02:07:25.930006 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:25.929976 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4991d4e3-973e-449a-89fd-d6c06dea0304-kube-api-access-9xhtd" (OuterVolumeSpecName: "kube-api-access-9xhtd") pod "4991d4e3-973e-449a-89fd-d6c06dea0304" (UID: "4991d4e3-973e-449a-89fd-d6c06dea0304"). InnerVolumeSpecName "kube-api-access-9xhtd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:07:26.029041 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.029006 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xhtd\" (UniqueName: \"kubernetes.io/projected/4991d4e3-973e-449a-89fd-d6c06dea0304-kube-api-access-9xhtd\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:07:26.507296 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.507260 2562 generic.go:356] "Generic (PLEG): container finished" podID="4991d4e3-973e-449a-89fd-d6c06dea0304" containerID="8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e" exitCode=0 Jun 15 02:07:26.507731 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.507302 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rgbgg" Jun 15 02:07:26.507731 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.507335 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgbgg" event={"ID":"4991d4e3-973e-449a-89fd-d6c06dea0304","Type":"ContainerDied","Data":"8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e"} Jun 15 02:07:26.507731 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.507366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rgbgg" event={"ID":"4991d4e3-973e-449a-89fd-d6c06dea0304","Type":"ContainerDied","Data":"afcd4cb990101763f29f64d6de7c92f88b8bf0509604c4650c330f915b3ebe3a"} Jun 15 02:07:26.507731 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.507381 2562 scope.go:117] "RemoveContainer" containerID="8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e" Jun 15 02:07:26.515906 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.515887 2562 scope.go:117] "RemoveContainer" containerID="8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e" Jun 15 02:07:26.516194 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:07:26.516175 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e\": container with ID starting with 8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e not found: ID does not exist" containerID="8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e" Jun 15 02:07:26.516238 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.516204 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e"} err="failed to get container status \"8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e\": rpc error: code = NotFound desc = could not find container \"8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e\": container with ID starting with 8ea1c4c73f25eaaa78d624624f7ff2646fd156af2571c01689593b5ab834df3e not found: ID does not exist" Jun 15 02:07:26.526922 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.526889 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgbgg"] Jun 15 02:07:26.538364 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:26.538326 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rgbgg"] Jun 15 02:07:27.787377 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:27.787338 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4991d4e3-973e-449a-89fd-d6c06dea0304" path="/var/lib/kubelet/pods/4991d4e3-973e-449a-89fd-d6c06dea0304/volumes" Jun 15 02:07:28.993273 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:28.993242 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:29.090639 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:29.090608 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:29.172752 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:29.172717 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:29.742305 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:29.742258 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:32.484125 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:32.484090 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:32.582317 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:32.582275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:39.070723 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:39.070687 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:46.597361 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:46.597309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:07:47.513734 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:07:47.513694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:03.258721 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:03.258683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:03.671739 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:03.671704 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:03.774915 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:03.774881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:05.778810 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:05.778783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 02:08:05.779190 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:05.778859 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 02:08:27.300679 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:27.300573 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:49.910612 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:49.910558 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:51.678796 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.678752 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6945c6bd75-2dbzw"] Jun 15 02:08:51.679351 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679293 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b9c1e49-e7ae-45ca-a863-6377247a8aee" containerName="authorino" Jun 15 02:08:51.679351 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679318 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b9c1e49-e7ae-45ca-a863-6377247a8aee" containerName="authorino" Jun 15 02:08:51.679351 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679338 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4991d4e3-973e-449a-89fd-d6c06dea0304" containerName="authorino" Jun 15 02:08:51.679351 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679347 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4991d4e3-973e-449a-89fd-d6c06dea0304" containerName="authorino" Jun 15 02:08:51.679630 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679383 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f8838d-434b-446f-8aa2-e07cb3e74edc" containerName="authorino" Jun 15 02:08:51.679630 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679393 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f8838d-434b-446f-8aa2-e07cb3e74edc" containerName="authorino" Jun 15 02:08:51.679630 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679490 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b9c1e49-e7ae-45ca-a863-6377247a8aee" containerName="authorino" Jun 15 02:08:51.679630 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679505 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4991d4e3-973e-449a-89fd-d6c06dea0304" containerName="authorino" Jun 15 02:08:51.679630 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.679520 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f8838d-434b-446f-8aa2-e07cb3e74edc" containerName="authorino" Jun 15 02:08:51.682673 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.682649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.684960 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.684937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 02:08:51.688991 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.688958 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6945c6bd75-2dbzw"] Jun 15 02:08:51.697181 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.697147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8c65b93-76f3-4268-b18d-72c0391462c9-tls-cert\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.697358 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.697207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqkpr\" (UniqueName: \"kubernetes.io/projected/e8c65b93-76f3-4268-b18d-72c0391462c9-kube-api-access-gqkpr\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.697358 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.697267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e8c65b93-76f3-4268-b18d-72c0391462c9-oidc-ca\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.798207 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.798174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e8c65b93-76f3-4268-b18d-72c0391462c9-oidc-ca\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.798385 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.798231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8c65b93-76f3-4268-b18d-72c0391462c9-tls-cert\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.798385 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.798294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqkpr\" (UniqueName: \"kubernetes.io/projected/e8c65b93-76f3-4268-b18d-72c0391462c9-kube-api-access-gqkpr\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.798979 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.798957 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/e8c65b93-76f3-4268-b18d-72c0391462c9-oidc-ca\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.801131 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.801109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e8c65b93-76f3-4268-b18d-72c0391462c9-tls-cert\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.806329 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.806310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqkpr\" (UniqueName: \"kubernetes.io/projected/e8c65b93-76f3-4268-b18d-72c0391462c9-kube-api-access-gqkpr\") pod \"authorino-6945c6bd75-2dbzw\" (UID: \"e8c65b93-76f3-4268-b18d-72c0391462c9\") " pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:51.994338 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:51.994242 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6945c6bd75-2dbzw" Jun 15 02:08:52.130589 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:52.130563 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6945c6bd75-2dbzw"] Jun 15 02:08:52.132735 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:08:52.132705 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode8c65b93_76f3_4268_b18d_72c0391462c9.slice/crio-8d75dd8c68628efa980e7311c78a4d14f1411bb1aba6301afc4543e57d87c072 WatchSource:0}: Error finding container 8d75dd8c68628efa980e7311c78a4d14f1411bb1aba6301afc4543e57d87c072: Status 404 returned error can't find the container with id 8d75dd8c68628efa980e7311c78a4d14f1411bb1aba6301afc4543e57d87c072 Jun 15 02:08:52.920880 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:52.920846 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6945c6bd75-2dbzw" event={"ID":"e8c65b93-76f3-4268-b18d-72c0391462c9","Type":"ContainerStarted","Data":"8765b3c8f1f309f10de79b51c8116652cb6f8b33f5641bae61882ad6c080293c"} Jun 15 02:08:52.920880 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:52.920885 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6945c6bd75-2dbzw" event={"ID":"e8c65b93-76f3-4268-b18d-72c0391462c9","Type":"ContainerStarted","Data":"8d75dd8c68628efa980e7311c78a4d14f1411bb1aba6301afc4543e57d87c072"} Jun 15 02:08:52.937002 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:52.936951 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6945c6bd75-2dbzw" podStartSLOduration=1.5308717459999999 podStartE2EDuration="1.93693126s" totalImagesPullingTime="406.059514ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:08:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:08:52.93425678 +0000 UTC m=+647.518148584" watchObservedRunningTime="2026-06-15 02:08:52.93693126 +0000 UTC m=+647.520823121" Jun 15 02:08:52.958445 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:52.958412 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff497f46c-jmr98"] Jun 15 02:08:52.958650 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:52.958628 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7ff497f46c-jmr98" podUID="b8b590ab-490f-4cfc-bc2d-73a019b523c8" containerName="authorino" containerID="cri-o://a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d" gracePeriod=30 Jun 15 02:08:53.206921 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.206891 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:08:53.312522 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.312482 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b590ab-490f-4cfc-bc2d-73a019b523c8-tls-cert\") pod \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " Jun 15 02:08:53.312706 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.312653 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sz8g\" (UniqueName: \"kubernetes.io/projected/b8b590ab-490f-4cfc-bc2d-73a019b523c8-kube-api-access-5sz8g\") pod \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\" (UID: \"b8b590ab-490f-4cfc-bc2d-73a019b523c8\") " Jun 15 02:08:53.314932 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.314900 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8b590ab-490f-4cfc-bc2d-73a019b523c8-kube-api-access-5sz8g" (OuterVolumeSpecName: "kube-api-access-5sz8g") pod "b8b590ab-490f-4cfc-bc2d-73a019b523c8" (UID: "b8b590ab-490f-4cfc-bc2d-73a019b523c8"). InnerVolumeSpecName "kube-api-access-5sz8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:08:53.323567 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.323522 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8b590ab-490f-4cfc-bc2d-73a019b523c8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b8b590ab-490f-4cfc-bc2d-73a019b523c8" (UID: "b8b590ab-490f-4cfc-bc2d-73a019b523c8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 02:08:53.413686 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.413651 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sz8g\" (UniqueName: \"kubernetes.io/projected/b8b590ab-490f-4cfc-bc2d-73a019b523c8-kube-api-access-5sz8g\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:08:53.413686 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.413679 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b8b590ab-490f-4cfc-bc2d-73a019b523c8-tls-cert\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:08:53.555443 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.555355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:53.608697 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.608661 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:08:53.926647 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.926614 2562 generic.go:356] "Generic (PLEG): container finished" podID="b8b590ab-490f-4cfc-bc2d-73a019b523c8" containerID="a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d" exitCode=0 Jun 15 02:08:53.927065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.926660 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ff497f46c-jmr98" Jun 15 02:08:53.927065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.926702 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff497f46c-jmr98" event={"ID":"b8b590ab-490f-4cfc-bc2d-73a019b523c8","Type":"ContainerDied","Data":"a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d"} Jun 15 02:08:53.927065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.926747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ff497f46c-jmr98" event={"ID":"b8b590ab-490f-4cfc-bc2d-73a019b523c8","Type":"ContainerDied","Data":"b41ad4bbd22b64b783b0edc3adb7159d7d41286bbf3c6151cdfab75e703049e5"} Jun 15 02:08:53.927065 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.926769 2562 scope.go:117] "RemoveContainer" containerID="a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d" Jun 15 02:08:53.936158 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.936134 2562 scope.go:117] "RemoveContainer" containerID="a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d" Jun 15 02:08:53.936503 ip-10-0-139-93 kubenswrapper[2562]: E0615 02:08:53.936477 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d\": container with ID starting with a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d not found: ID does not exist" containerID="a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d" Jun 15 02:08:53.936630 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.936510 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d"} err="failed to get container status \"a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d\": rpc error: code = NotFound desc = could not find container \"a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d\": container with ID starting with a8d8a7865efe63ed78a8898590989b90d9b2c8600c030219ec79a8b83ad86e4d not found: ID does not exist" Jun 15 02:08:53.947507 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.947477 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ff497f46c-jmr98"] Jun 15 02:08:53.950212 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:53.950186 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7ff497f46c-jmr98"] Jun 15 02:08:55.788064 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:55.788029 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b590ab-490f-4cfc-bc2d-73a019b523c8" path="/var/lib/kubelet/pods/b8b590ab-490f-4cfc-bc2d-73a019b523c8/volumes" Jun 15 02:08:59.274846 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:08:59.274813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:09:04.967162 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:09:04.967129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:09:40.955504 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:09:40.955469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:09:58.276093 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:09:58.276007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:10:08.771913 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:10:08.771877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:10:17.839661 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:10:17.839618 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:11:10.381291 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:11:10.381256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:11:10.481699 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:11:10.481658 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:13:05.808850 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:13:05.808824 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 02:13:05.810834 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:13:05.810809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bql95_167e163e-9658-4668-8d8e-5bc3b21e94b5/ovn-acl-logging/0.log" Jun 15 02:13:16.301692 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:13:16.301647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:15:00.141230 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.141183 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29691495-447xp"] Jun 15 02:15:00.143900 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.141756 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b590ab-490f-4cfc-bc2d-73a019b523c8" containerName="authorino" Jun 15 02:15:00.143900 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.141772 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b590ab-490f-4cfc-bc2d-73a019b523c8" containerName="authorino" Jun 15 02:15:00.143900 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.141846 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b590ab-490f-4cfc-bc2d-73a019b523c8" containerName="authorino" Jun 15 02:15:00.145001 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.144983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:00.147211 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.147192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-zlmm9\"" Jun 15 02:15:00.160799 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.160775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691495-447xp"] Jun 15 02:15:00.273633 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.273594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48ntj\" (UniqueName: \"kubernetes.io/projected/12820fad-948f-42f0-ac58-7f31db36b042-kube-api-access-48ntj\") pod \"maas-api-key-cleanup-29691495-447xp\" (UID: \"12820fad-948f-42f0-ac58-7f31db36b042\") " pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:00.375064 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.375024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48ntj\" (UniqueName: \"kubernetes.io/projected/12820fad-948f-42f0-ac58-7f31db36b042-kube-api-access-48ntj\") pod \"maas-api-key-cleanup-29691495-447xp\" (UID: \"12820fad-948f-42f0-ac58-7f31db36b042\") " pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:00.382676 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.382648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48ntj\" (UniqueName: \"kubernetes.io/projected/12820fad-948f-42f0-ac58-7f31db36b042-kube-api-access-48ntj\") pod \"maas-api-key-cleanup-29691495-447xp\" (UID: \"12820fad-948f-42f0-ac58-7f31db36b042\") " pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:00.455269 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.455167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:00.585874 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.585670 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29691495-447xp"] Jun 15 02:15:00.588622 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:15:00.588591 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12820fad_948f_42f0_ac58_7f31db36b042.slice/crio-5b8ed2191b50c4c916eb736634f9eb957fda8dc8744ed0de7053c39fde361bac WatchSource:0}: Error finding container 5b8ed2191b50c4c916eb736634f9eb957fda8dc8744ed0de7053c39fde361bac: Status 404 returned error can't find the container with id 5b8ed2191b50c4c916eb736634f9eb957fda8dc8744ed0de7053c39fde361bac Jun 15 02:15:00.590390 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.590374 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 02:15:00.675564 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:00.675507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" event={"ID":"12820fad-948f-42f0-ac58-7f31db36b042","Type":"ContainerStarted","Data":"5b8ed2191b50c4c916eb736634f9eb957fda8dc8744ed0de7053c39fde361bac"} Jun 15 02:15:04.695408 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:04.695316 2562 generic.go:356] "Generic (PLEG): container finished" podID="12820fad-948f-42f0-ac58-7f31db36b042" containerID="ef65657e6e2fa35428103b46d76fe032d8a05b17a71958040003e58a99fb86b4" exitCode=0 Jun 15 02:15:04.695408 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:04.695368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" event={"ID":"12820fad-948f-42f0-ac58-7f31db36b042","Type":"ContainerDied","Data":"ef65657e6e2fa35428103b46d76fe032d8a05b17a71958040003e58a99fb86b4"} Jun 15 02:15:05.836205 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:05.836180 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:05.923724 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:05.923686 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48ntj\" (UniqueName: \"kubernetes.io/projected/12820fad-948f-42f0-ac58-7f31db36b042-kube-api-access-48ntj\") pod \"12820fad-948f-42f0-ac58-7f31db36b042\" (UID: \"12820fad-948f-42f0-ac58-7f31db36b042\") " Jun 15 02:15:05.926003 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:05.925976 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12820fad-948f-42f0-ac58-7f31db36b042-kube-api-access-48ntj" (OuterVolumeSpecName: "kube-api-access-48ntj") pod "12820fad-948f-42f0-ac58-7f31db36b042" (UID: "12820fad-948f-42f0-ac58-7f31db36b042"). InnerVolumeSpecName "kube-api-access-48ntj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 02:15:06.025638 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:06.025549 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48ntj\" (UniqueName: \"kubernetes.io/projected/12820fad-948f-42f0-ac58-7f31db36b042-kube-api-access-48ntj\") on node \"ip-10-0-139-93.ec2.internal\" DevicePath \"\"" Jun 15 02:15:06.705399 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:06.705369 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" Jun 15 02:15:06.705399 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:06.705383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29691495-447xp" event={"ID":"12820fad-948f-42f0-ac58-7f31db36b042","Type":"ContainerDied","Data":"5b8ed2191b50c4c916eb736634f9eb957fda8dc8744ed0de7053c39fde361bac"} Jun 15 02:15:06.705623 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:06.705448 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b8ed2191b50c4c916eb736634f9eb957fda8dc8744ed0de7053c39fde361bac" Jun 15 02:15:12.800036 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:12.800000 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:15:19.917198 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:19.917157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:15:19.965763 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:15:19.965724 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:16:31.066111 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:31.066070 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6945c6bd75-2dbzw_e8c65b93-76f3-4268-b18d-72c0391462c9/authorino/0.log" Jun 15 02:16:36.051955 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:36.051921 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691495-447xp_12820fad-948f-42f0-ac58-7f31db36b042/cleanup/0.log" Jun 15 02:16:36.745179 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:36.745153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9f678f6b-mtg2n_cac5a863-2f56-495d-aa20-1c1f4a5e709b/copy-manifests/0.log" Jun 15 02:16:36.764633 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:36.764598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9f678f6b-mtg2n_cac5a863-2f56-495d-aa20-1c1f4a5e709b/manager/0.log" Jun 15 02:16:38.108296 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:38.108266 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6945c6bd75-2dbzw_e8c65b93-76f3-4268-b18d-72c0391462c9/authorino/0.log" Jun 15 02:16:38.323662 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:38.323600 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fgsbx_a61a402f-8100-48af-8197-5382c4a3e1e0/manager/0.log" Jun 15 02:16:38.669336 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:38.669292 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hqz26_bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc/manager/0.log" Jun 15 02:16:39.578145 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:39.578115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8986dff5-wlpqd_79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44/kube-auth-proxy/0.log" Jun 15 02:16:45.095969 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.095928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:16:45.096379 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.096083 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jb8zr/must-gather-rhdbt"] Jun 15 02:16:45.096469 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.096457 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12820fad-948f-42f0-ac58-7f31db36b042" containerName="cleanup" Jun 15 02:16:45.096522 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.096471 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="12820fad-948f-42f0-ac58-7f31db36b042" containerName="cleanup" Jun 15 02:16:45.096585 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.096574 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="12820fad-948f-42f0-ac58-7f31db36b042" containerName="cleanup" Jun 15 02:16:45.099739 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.099724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.102181 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.102156 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jb8zr\"/\"kube-root-ca.crt\"" Jun 15 02:16:45.102369 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.102203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jb8zr\"/\"openshift-service-ca.crt\"" Jun 15 02:16:45.103016 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.103001 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jb8zr\"/\"default-dockercfg-f7vkr\"" Jun 15 02:16:45.114076 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.114048 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jb8zr/must-gather-rhdbt"] Jun 15 02:16:45.151448 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.151413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" limit=1024 Jun 15 02:16:45.227476 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.227435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzh5m\" (UniqueName: \"kubernetes.io/projected/13e4cf05-5063-4936-ad77-b4420bd3e2ca-kube-api-access-fzh5m\") pod \"must-gather-rhdbt\" (UID: \"13e4cf05-5063-4936-ad77-b4420bd3e2ca\") " pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.227701 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.227494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/13e4cf05-5063-4936-ad77-b4420bd3e2ca-must-gather-output\") pod \"must-gather-rhdbt\" (UID: \"13e4cf05-5063-4936-ad77-b4420bd3e2ca\") " pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.328093 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.328051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzh5m\" (UniqueName: \"kubernetes.io/projected/13e4cf05-5063-4936-ad77-b4420bd3e2ca-kube-api-access-fzh5m\") pod \"must-gather-rhdbt\" (UID: \"13e4cf05-5063-4936-ad77-b4420bd3e2ca\") " pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.328302 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.328104 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/13e4cf05-5063-4936-ad77-b4420bd3e2ca-must-gather-output\") pod \"must-gather-rhdbt\" (UID: \"13e4cf05-5063-4936-ad77-b4420bd3e2ca\") " pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.328451 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.328432 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/13e4cf05-5063-4936-ad77-b4420bd3e2ca-must-gather-output\") pod \"must-gather-rhdbt\" (UID: \"13e4cf05-5063-4936-ad77-b4420bd3e2ca\") " pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.335706 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.335684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzh5m\" (UniqueName: \"kubernetes.io/projected/13e4cf05-5063-4936-ad77-b4420bd3e2ca-kube-api-access-fzh5m\") pod \"must-gather-rhdbt\" (UID: \"13e4cf05-5063-4936-ad77-b4420bd3e2ca\") " pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.408676 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.408592 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jb8zr/must-gather-rhdbt" Jun 15 02:16:45.544384 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:45.544321 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jb8zr/must-gather-rhdbt"] Jun 15 02:16:45.546835 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:16:45.546803 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13e4cf05_5063_4936_ad77_b4420bd3e2ca.slice/crio-5e97cf4a71cff70979c9afa545c4237462b21564fd88270abdeb050aaaa6667a WatchSource:0}: Error finding container 5e97cf4a71cff70979c9afa545c4237462b21564fd88270abdeb050aaaa6667a: Status 404 returned error can't find the container with id 5e97cf4a71cff70979c9afa545c4237462b21564fd88270abdeb050aaaa6667a Jun 15 02:16:46.189440 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:46.189401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jb8zr/must-gather-rhdbt" event={"ID":"13e4cf05-5063-4936-ad77-b4420bd3e2ca","Type":"ContainerStarted","Data":"5e97cf4a71cff70979c9afa545c4237462b21564fd88270abdeb050aaaa6667a"} Jun 15 02:16:47.198383 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:47.198325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jb8zr/must-gather-rhdbt" event={"ID":"13e4cf05-5063-4936-ad77-b4420bd3e2ca","Type":"ContainerStarted","Data":"4dc0773051c6236324674ad570cf14109eb06d5f9be921f39729b9edb40e26b8"} Jun 15 02:16:47.198383 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:47.198388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jb8zr/must-gather-rhdbt" event={"ID":"13e4cf05-5063-4936-ad77-b4420bd3e2ca","Type":"ContainerStarted","Data":"144a754286dd71ad50e2ed6de3bd0d0e34dac66f329ca919ec32072121e06c56"} Jun 15 02:16:47.213902 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:47.213840 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jb8zr/must-gather-rhdbt" podStartSLOduration=1.373166884 podStartE2EDuration="2.213820716s" totalImagesPullingTime="840.653832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 02:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:16:47.213109167 +0000 UTC m=+1121.797000970" watchObservedRunningTime="2026-06-15 02:16:47.213820716 +0000 UTC m=+1121.797712520" Jun 15 02:16:48.050434 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:48.050399 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9kcc_fe74fdac-c36b-4513-ab6b-a73ae892e085/global-pull-secret-syncer/0.log" Jun 15 02:16:48.098952 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:48.098919 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hj85b_1083a323-51f0-4221-bbce-2c7973b7c1a1/konnectivity-agent/0.log" Jun 15 02:16:48.201077 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:48.201045 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-93.ec2.internal_578f1ddaea42b73ed5919bd0640b2e20/haproxy/0.log" Jun 15 02:16:52.971113 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:52.971011 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6945c6bd75-2dbzw_e8c65b93-76f3-4268-b18d-72c0391462c9/authorino/0.log" Jun 15 02:16:53.046106 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:53.046067 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-fgsbx_a61a402f-8100-48af-8197-5382c4a3e1e0/manager/0.log" Jun 15 02:16:53.158594 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:53.158553 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hqz26_bf9a01fb-3d1c-49f7-91db-4eec6c9e17fc/manager/0.log" Jun 15 02:16:54.990820 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:54.990785 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/alertmanager/0.log" Jun 15 02:16:55.016254 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.016154 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/config-reloader/0.log" Jun 15 02:16:55.040430 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.040395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/kube-rbac-proxy-web/0.log" Jun 15 02:16:55.063087 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.063056 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/kube-rbac-proxy/0.log" Jun 15 02:16:55.085259 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.085226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/kube-rbac-proxy-metric/0.log" Jun 15 02:16:55.112127 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.112093 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/prom-label-proxy/0.log" Jun 15 02:16:55.147984 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.147948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b7b24eea-a9ac-4b24-9f97-8ac74476cf79/init-config-reloader/0.log" Jun 15 02:16:55.241197 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.240874 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-6tmfp_bfe81919-18ee-43eb-8c97-36f55fff7c9f/kube-state-metrics/0.log" Jun 15 02:16:55.267615 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.266124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-6tmfp_bfe81919-18ee-43eb-8c97-36f55fff7c9f/kube-rbac-proxy-main/0.log" Jun 15 02:16:55.297552 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.297510 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-6tmfp_bfe81919-18ee-43eb-8c97-36f55fff7c9f/kube-rbac-proxy-self/0.log" Jun 15 02:16:55.337062 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.336470 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7c786584c8-vwkhz_7d862747-b2c6-4668-83e6-83529336010a/metrics-server/0.log" Jun 15 02:16:55.375711 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.375680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-xtxm2_4c97face-7332-4dba-9b61-7b7ff87068d9/monitoring-plugin/0.log" Jun 15 02:16:55.484928 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.484897 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5hs4_fe3d11c8-e168-4363-ab38-c45569cb532d/node-exporter/0.log" Jun 15 02:16:55.505672 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.505612 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5hs4_fe3d11c8-e168-4363-ab38-c45569cb532d/kube-rbac-proxy/0.log" Jun 15 02:16:55.528196 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.528109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-w5hs4_fe3d11c8-e168-4363-ab38-c45569cb532d/init-textfile/0.log" Jun 15 02:16:55.641370 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.641332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-5xddx_aee1abf3-5762-446d-8584-6ae78c73413d/kube-rbac-proxy-main/0.log" Jun 15 02:16:55.664555 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.664506 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-5xddx_aee1abf3-5762-446d-8584-6ae78c73413d/kube-rbac-proxy-self/0.log" Jun 15 02:16:55.691792 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.691712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-5xddx_aee1abf3-5762-446d-8584-6ae78c73413d/openshift-state-metrics/0.log" Jun 15 02:16:55.741814 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.741780 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/prometheus/0.log" Jun 15 02:16:55.774688 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.774655 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/config-reloader/0.log" Jun 15 02:16:55.802286 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.802165 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/thanos-sidecar/0.log" Jun 15 02:16:55.823791 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.823763 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/kube-rbac-proxy-web/0.log" Jun 15 02:16:55.846125 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.846056 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/kube-rbac-proxy/0.log" Jun 15 02:16:55.868581 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.868550 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/kube-rbac-proxy-thanos/0.log" Jun 15 02:16:55.891165 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.891124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8d71a602-7b23-4491-b222-9a90b0bafcf1/init-config-reloader/0.log" Jun 15 02:16:55.922002 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.921962 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-6cnbv_c1d4197a-8d70-4d81-8454-ea6a203a7baf/prometheus-operator/0.log" Jun 15 02:16:55.941319 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.941290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-6cnbv_c1d4197a-8d70-4d81-8454-ea6a203a7baf/kube-rbac-proxy/0.log" Jun 15 02:16:55.996716 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:55.996686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9cb4499d-r7ksp_f7cf8024-b04d-4db5-a93e-63a78f4771d8/telemeter-client/0.log" Jun 15 02:16:56.020220 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.020181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9cb4499d-r7ksp_f7cf8024-b04d-4db5-a93e-63a78f4771d8/reload/0.log" Jun 15 02:16:56.046835 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.046804 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f9cb4499d-r7ksp_f7cf8024-b04d-4db5-a93e-63a78f4771d8/kube-rbac-proxy/0.log" Jun 15 02:16:56.072683 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.072590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57797d7685-qvvkx_64594edc-f52f-46b2-9e12-cd9ed1ec0fcd/thanos-query/0.log" Jun 15 02:16:56.098271 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.098159 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57797d7685-qvvkx_64594edc-f52f-46b2-9e12-cd9ed1ec0fcd/kube-rbac-proxy-web/0.log" Jun 15 02:16:56.128758 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.128726 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57797d7685-qvvkx_64594edc-f52f-46b2-9e12-cd9ed1ec0fcd/kube-rbac-proxy/0.log" Jun 15 02:16:56.152235 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.152133 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57797d7685-qvvkx_64594edc-f52f-46b2-9e12-cd9ed1ec0fcd/prom-label-proxy/0.log" Jun 15 02:16:56.173095 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.173056 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57797d7685-qvvkx_64594edc-f52f-46b2-9e12-cd9ed1ec0fcd/kube-rbac-proxy-rules/0.log" Jun 15 02:16:56.195741 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:56.195706 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-57797d7685-qvvkx_64594edc-f52f-46b2-9e12-cd9ed1ec0fcd/kube-rbac-proxy-metrics/0.log" Jun 15 02:16:59.269706 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.269657 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw"] Jun 15 02:16:59.276184 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.276155 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.286918 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.286882 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw"] Jun 15 02:16:59.381760 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.381717 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-lib-modules\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.381947 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.381783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-sys\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.381947 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.381820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-podres\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.381947 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.381856 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxgwf\" (UniqueName: \"kubernetes.io/projected/74182c1c-7acc-4b8e-8b18-a1d05836d17c-kube-api-access-mxgwf\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.381947 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.381942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-proc\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.483319 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.483283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-sys\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.483573 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.483511 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-sys\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.483752 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.483730 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-podres\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.484019 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.484003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxgwf\" (UniqueName: \"kubernetes.io/projected/74182c1c-7acc-4b8e-8b18-a1d05836d17c-kube-api-access-mxgwf\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.484628 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.484607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-proc\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.484891 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.484871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-lib-modules\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.485173 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.483946 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-podres\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.485294 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.485075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-lib-modules\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.485384 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.484783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74182c1c-7acc-4b8e-8b18-a1d05836d17c-proc\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.492142 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.492105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxgwf\" (UniqueName: \"kubernetes.io/projected/74182c1c-7acc-4b8e-8b18-a1d05836d17c-kube-api-access-mxgwf\") pod \"perf-node-gather-daemonset-8klbw\" (UID: \"74182c1c-7acc-4b8e-8b18-a1d05836d17c\") " pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.594122 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.593807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:16:59.790604 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:16:59.790261 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw"] Jun 15 02:16:59.790861 ip-10-0-139-93 kubenswrapper[2562]: W0615 02:16:59.790815 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod74182c1c_7acc_4b8e_8b18_a1d05836d17c.slice/crio-1760709255d4774e87cbaf9e2bb68d9122d40b857da2c7d00479d39442bd9ed6 WatchSource:0}: Error finding container 1760709255d4774e87cbaf9e2bb68d9122d40b857da2c7d00479d39442bd9ed6: Status 404 returned error can't find the container with id 1760709255d4774e87cbaf9e2bb68d9122d40b857da2c7d00479d39442bd9ed6 Jun 15 02:17:00.297594 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.297487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" event={"ID":"74182c1c-7acc-4b8e-8b18-a1d05836d17c","Type":"ContainerStarted","Data":"b30ce6b693584cc4b54bd56e62585cf1480c596e3794968747b517c35e36575a"} Jun 15 02:17:00.298048 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.297711 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:17:00.298048 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.297754 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" event={"ID":"74182c1c-7acc-4b8e-8b18-a1d05836d17c","Type":"ContainerStarted","Data":"1760709255d4774e87cbaf9e2bb68d9122d40b857da2c7d00479d39442bd9ed6"} Jun 15 02:17:00.313455 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.313395 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" podStartSLOduration=1.313373508 podStartE2EDuration="1.313373508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 02:16:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 02:17:00.312499307 +0000 UTC m=+1134.896391133" watchObservedRunningTime="2026-06-15 02:17:00.313373508 +0000 UTC m=+1134.897265323" Jun 15 02:17:00.885748 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.885712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tf2dr_47ee0514-d93b-4d61-8799-8176b7eb97f3/dns/0.log" Jun 15 02:17:00.906640 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.906603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tf2dr_47ee0514-d93b-4d61-8799-8176b7eb97f3/kube-rbac-proxy/0.log" Jun 15 02:17:00.983719 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:00.983690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wjwwn_624fe62d-eaad-433f-add3-8e090b7e1b38/dns-node-resolver/0.log" Jun 15 02:17:01.545393 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:01.545360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s7ntl_a23f5598-3393-4ac3-8713-572956063835/node-ca/0.log" Jun 15 02:17:02.614694 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:02.614665 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8986dff5-wlpqd_79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44/kube-auth-proxy/0.log" Jun 15 02:17:03.349566 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:03.349525 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lpxn5_0411f206-78c8-458a-a277-573b9a14615d/serve-healthcheck-canary/0.log" Jun 15 02:17:04.050848 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:04.050806 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrbw4_cdba5a13-3ae7-4290-a97f-b370a7c18822/kube-rbac-proxy/0.log" Jun 15 02:17:04.073670 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:04.073641 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrbw4_cdba5a13-3ae7-4290-a97f-b370a7c18822/exporter/0.log" Jun 15 02:17:04.097509 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:04.097479 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lrbw4_cdba5a13-3ae7-4290-a97f-b370a7c18822/extractor/0.log" Jun 15 02:17:06.318687 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:06.318656 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jb8zr/perf-node-gather-daemonset-8klbw" Jun 15 02:17:06.653813 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:06.653786 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29691495-447xp_12820fad-948f-42f0-ac58-7f31db36b042/cleanup/0.log" Jun 15 02:17:06.942628 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:06.942493 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9f678f6b-mtg2n_cac5a863-2f56-495d-aa20-1c1f4a5e709b/manager/0.log" Jun 15 02:17:06.958798 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:06.958771 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f9f678f6b-mtg2n_cac5a863-2f56-495d-aa20-1c1f4a5e709b/copy-manifests/0.log" Jun 15 02:17:08.637332 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:08.637299 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c55858464-rbglx_037138f2-a341-4220-aa07-754af61358c3/manager/0.log" Jun 15 02:17:14.095597 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:14.095505 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8986dff5-wlpqd_79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44/kube-auth-proxy/0.log" Jun 15 02:17:15.365162 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.365099 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8986dff5-wlpqd_79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44/kube-auth-proxy/0.log" Jun 15 02:17:15.829650 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.829622 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/kube-multus-additional-cni-plugins/0.log" Jun 15 02:17:15.851389 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.851351 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/egress-router-binary-copy/0.log" Jun 15 02:17:15.876671 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.876634 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/cni-plugins/0.log" Jun 15 02:17:15.898571 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.898520 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/bond-cni-plugin/0.log" Jun 15 02:17:15.920627 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.920599 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/routeoverride-cni/0.log" Jun 15 02:17:15.943028 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.942994 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/whereabouts-cni-bincopy/0.log" Jun 15 02:17:15.964407 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:15.964371 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hb74t_7009d4dd-06b3-4f23-be79-ce339b4bd492/whereabouts-cni/0.log" Jun 15 02:17:16.196699 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:16.196602 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rjqhj_499434fd-8161-4177-8ea1-34f897544ef1/kube-multus/0.log" Jun 15 02:17:16.289714 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:16.289680 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lxtkn_67ff0471-0c24-4354-a459-310b8c44af0c/network-metrics-daemon/0.log" Jun 15 02:17:16.309596 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:16.309566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lxtkn_67ff0471-0c24-4354-a459-310b8c44af0c/kube-rbac-proxy/0.log" Jun 15 02:17:17.161783 ip-10-0-139-93 kubenswrapper[2562]: I0615 02:17:17.161753 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d8986dff5-wlpqd_79a7c1e0-23d9-47c9-9e5b-d4f5e78aeb44/kube-auth-proxy/0.log"